Local AI · Recipe · 2× DGX Spark

MiMo-V2.6-Flash 309B MXFP4 with SGLang on 2× DGX Spark

MiMo-V2.6-Flash 309B MXFP4 with SGLang on 2× DGX Spark: 35 tok/s according to github.com (dataset as of Nov 3, 2026).

by MiaAI-Lab

35tok/sEveryday

1 request, prose prompt, with EAGLE

Source: github.com
Intelligence (original model) · Artificial Analysisno independent value

Engine

Engine
SGLang
Quantization
FP8 attention + MXFP4 experts (Original)
Model family
MiMo-V2.6-Flash
Context
1,048,576
Parameters
309B total / 15B active
Creator
MiaAI-Lab
GitHub stars
32
Repo updated
Sep 25, 2026

Measurements

Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.

Decode · 1 request

  • Everyday (decode)35 tok/sProse, EAGLE MTP, TTFT 332 ms Source 
  • Peak (decode)69.8 tok/sCode, DFlash Source 

Prefill by context

What you need

Hardware
2 × NVIDIA DGX Spark (GB10)
Engine
SGLang
Context
1,048,576 tokens

Related recipes

2× DGX Spark
89.3tok/sEveryday

1 request, prose prompt, with MTP (per recipe) Source 

Intelligenceno independent value
  • Custom kernel required
  • License unclear

INT4-AutoRound (GPTQ int4, Top-5-Experten) + FP8 n-gram-Tabelle, FP8 KVTensorFold tensorfold-native (Zig, zig-flashnext db281878 + patches), Image ghcr.io/miaai-lab/qwen3.8-flash-dual-dgx-sparks-tensorfold:zig-db28187-f3e1300f4f62, TP=2 über CX7/RoCE, MTP + Copy-Drafts (QUANT=int4ar)Weights Repo Updated Oct 26, 2026

Details
2× DGX Spark
74tok/sEveryday

1 request, prose prompt (long story), thinking off, with MTP Source 

Intelligence40with thinking
  • Custom kernel required
  • License unclear

INT4-AutoRound (azampatti): int4-Experten, fp8-Seitenschichten; n-gram-Tabelle beim Laden fp8 → NVFP4, halb pro Box auf der GPU; KV-Pin 29G/Box (1.829.182 Tokens)vLLM 0.30 (Image myllmbox/qwen38-flash-next-cluster-vllm:v5.2; RecoverSSM, dynamischer Draft-Depth 3–7 in Full-CUDA-Graphs, sampled Drafts + Block-Verifikation, One-Shot-RoCE-All-Reduce, Dual-Rail, TP=2, 64 Seats) — Kit v5.2Weights Repo Updated Oct 29, 2026

Details

← Back to overview

Local AI in your company?

In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.