EVO2 40B on A100 #229
EVO2 40B on A100
#229
Replies: 1 comment
|
The 7B models can be safely used without fp8 and will fit on 1xA100. Other sizes require hopper GPUs |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Can I run EVO2 40B on 6xA100. I got error regarding FP8 computation.
All reactions