Local AI · Recipe · 4× RTX PRO 6000

MiniMax-M3 428B-A23B MXFP4 with vLLM on 4× RTX PRO 6000

by 0xSero

113tok/sPeak

1 request, best value reported by source

Source: github.com
Intelligence (original model) · Artificial Analysis29with thinking

Engine

Engine
vLLM gepatchtes vllm/vllm-openai
Quantization
MXFP4, BF16 KV
Model family
MiniMax-M3
Context
250,000
Parameters
428B MoE / 23B active
Creator
0xSero
GitHub stars
22
Repo updated
Sep 16, 2026

Measurements

Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.

No sourced measurements for this recipe.

What you need

Hardware
4 × NVIDIA RTX PRO 6000 Blackwell
Weights
Engine
vLLM gepatchtes vllm/vllm-openai
Context
250,000 tokens

Related recipes

← Back to overview

Local AI in your company?

In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.