Skip to content

perf(qsa): multi-threadgroup scoring, quantized pooled keys, and deep MTP throttling for 546k+ decode speed - #413

Open
maceip wants to merge 718 commits into
youssofal:mainfrom
maceip:feat/qsa-decode-throughput-546k
Open

perf(qsa): multi-threadgroup scoring, quantized pooled keys, and deep MTP throttling for 546k+ decode speed#413
maceip wants to merge 718 commits into
youssofal:mainfrom
maceip:feat/qsa-decode-throughput-546k

fix(qsa): derive pooled f32 view consistently from quantized represen…

a83fdab
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs