Add DeepSeek-V4.1 model - #1895

Open

Goekdeniz-Guelmez wants to merge 4 commits into

ml-explore:mainfrom

Goekdeniz-Guelmez:add-deepseek-v4.1

Commits on Sep 16, 2026

Add unit tests for DeepSeek-V4.1 model parity checks
Goekdeniz-Guelmez
committed
e783d86
Refactor DeepSeek-V4.1 model: streamline code, replace custom RMSNorm with nn.RMSNorm, and enhance SwiGLU activation implementation.
Goekdeniz-Guelmez
committed
7a53595
Enhance YarnRoPE and DeepSeek-V4.1: Refactor _apply_rope for improved scaling and inverse handling; add unit tests for partial RoPE support with strided positions.
Goekdeniz-Guelmez
committed
f963a0a

Commits on Sep 17, 2026

Merge branch 'main' into add-deepseek-v4.1
Goekdeniz-Guelmez
authored
00efcc2