Skip to content

Fix deepseek_v32 Indexer evicting attention sinks from sparse top-k - #1552

Open
robertlangdonn wants to merge 2 commits into
ml-explore:mainfrom
robertlangdonn:fix-deepseek-indexer-attention-sinks
Open

Fix deepseek_v32 Indexer evicting attention sinks from sparse top-k#1552
robertlangdonn wants to merge 2 commits into
ml-explore:mainfrom
robertlangdonn:fix-deepseek-indexer-attention-sinks

Handle batched/left-padded offsets in the sink-forcing mask

a37627b
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs