Devstral-2 NVFP4?
#3
by
reneho
- opened
Any chance to get the new Mistral Devstral-2 in NVFP4? Would be super interesting to compare with MiniMax-M2 and should be able to run on a single NVIDIA RTX Pro 6000.
https://huggingface.co/mistralai/Devstral-2-123B-Instruct-2512
I'll give it a shot.
super, your MiniMax-M2-NVFP4 works very well on 2 x RTX Pro 6000.
MiniMax-M2-NVFP4 on 2 A6000 - (71.96 tokens/s - simple python test) - looks good.