Skip to content

Support uneven tensor-parallel sharding in shard() (GQA/MLA-aware) - #1863

Open
twallgren wants to merge 3 commits into
ml-explore:mainfrom
twallgren:pr3-uneven-tensor-parallel-sharding
Open

Support uneven tensor-parallel sharding in shard() (GQA/MLA-aware)#1863
twallgren wants to merge 3 commits into
ml-explore:mainfrom
twallgren:pr3-uneven-tensor-parallel-sharding

Drop stale cache guards already reverted upstream in #1861

7ce3051
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs