4× RTX PRO 6000
113tok/sPeak
1 request, best value reported by source Source
Intelligence29with thinking
- License unclear
Local AI · Recipe · 4× RTX PRO 6000
MiniMax-M3 428B-A23B NVFP4 with SGLang on 4× RTX PRO 6000
by 0xSero
Engine
- Engine
- SGLang
- Quantization
- NVFP4 (modelopt_fp4), BF16 KV
- Model family
- MiniMax-M3
- Context
- 643,659
- Parameters
- 428B MoE / 23B active
- Creator
- 0xSero
- GitHub stars
- 22
- Repo updated
- Sep 16, 2026
Measurements
Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.
No sourced measurements for this recipe.
What you need
- Hardware
- 4 × NVIDIA RTX PRO 6000 Blackwell
- Weights
- Main weightslukealonso/MiniMax-M3-NVFP4 License unclear
- Engine
- SGLang
- Context
- 643,659 tokens
Related recipes
4× RTX PRO 6000
39.2tok/sPeak
1 request, synthetic prompt Source
Intelligence29with thinking
- License unclear
4× DGX Spark
38tok/sPeak
1 request, best value reported by source Source
Intelligence29with thinking
- License unclear
2× DGX Spark
36.6tok/sPeak
1 request, JSON prompt, context 196k Source
Intelligence29with thinking
- License unclear
4× DGX Spark
33.7tok/sPeak
1 request, best value reported by source Source
Intelligence29with thinking
- Experimental
- Custom kernel required
- License unclear
3× DGX Spark
10.5tok/sPeak
1 request, best value reported by source Source
Intelligence29with thinking
- License unclear
Local AI in your company?
In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.