Skip to content

Tighten SM90 tiles across head/value dimensions - #12

Merged
ivandobskygithub merged 2 commits into
mainfrom
codex/fix-flashattention-shared-memory-error-9r3bnw
Nov 24, 2025
Merged

ivandobskygithub merged 2 commits into
mainfrom
codex/fix-flashattention-shared-memory-error-9r3bnw

Conversation

@ivandobskygithub

Copy link
Copy Markdown
Owner

Summary

  • shrink SM90 tiles for dv>=256 at small head sizes to stay within consumer shared memory
  • use 64xN shapes for head dimensions above 192 with narrower BlockN when value tiles are wide

Testing

  • not run (not requested)

Codex Task

@ivandobskygithub
ivandobskygithub merged commit bce9fc8 into main Nov 24, 2025
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant