Local AI · Recipe · 2× DGX Spark

MiMo-V2.6-Flash 309B-A15B MXFP4 with vLLM on 2× DGX Spark

by tonyd2wild

53.3tok/sMixed

1 request, mixed prompt set, with DFlash (per recipe)

Source: github.com
Intelligence (original model) · Artificial Analysisno independent value

Engine

Engine
vLLM
Quantization
MXFP4 experts (marlin) + FP8 KV
Model family
MiMo-V2.6-Flash
Context
300,000
Parameters
309B / 15B active (lt. Mia-README)
Creator
tonyd2wild
GitHub stars
43
Repo updated
Sep 24, 2026

Measurements

Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.

No sourced measurements for this recipe.

What you need

Hardware
2 × NVIDIA DGX Spark (GB10)
Engine
vLLM
Context
300,000 tokens

Related recipes

← Back to overview

Local AI in your company?

In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.