Local AI · Recipe · 4× DGX Spark

DeepSeek-V4.1-Flash MXFP4 with SGLang on 4× DGX Spark (MiaAI-Lab)

DeepSeek-V4.1-Flash MXFP4 with SGLang on 4× DGX Spark (MiaAI-Lab): 87.7 tok/s according to github.com (dataset as of Nov 3, 2026).

by MiaAI-Lab

87.7tok/sEveryday

1 request, prose prompt, with DSpark (per recipe)

Source: github.com
Intelligence (original model) · Artificial Analysis40with thinkingno thinking 25

Engine

Engine
SGLang
Quantization
MXFP4 experts + FP8 dense, Engram-Tabellen auf NVMe
Model family
DeepSeek-V4.1-Flash
Context
1,048,576
Creator
MiaAI-Lab
GitHub stars
281
Repo updated
Oct 17, 2026

Measurements

Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.

Decode · 1 request

  • Everyday (decode)87.7 tok/sProse, greedy, 256 tok, sparkDash Source 
  • Peak (decode)152 tok/sStructured, greedy, 256 tok, sparkDash Source 

Prefill by context

  • 64K5,925 tok/sCold, sparkDash 1.8.8, synthetischer Füller; realer Text 16k–128k 4.9k–5.0k Source 

What you need

Hardware
4 × NVIDIA DGX Spark (GB10)
Engine
SGLang
Context
1,048,576 tokens

Related recipes

8× DGX Spark
74tok/sEveryday

1 request, generation at 32K context (speed table, ring of eight), thinking on, high, with DSpark (per recipe); experimental profile Source 

  • Custom kernel required
  • Experimental

Stock-Checkpoint FP8/MXFP4 (DeepSeek)vLLM (local-inference-lab Fork) via SparkRing (SIRCL-Collectives, switchless RDMA ueber ConnectX-7), Image Release 2026.10.2Weights Repo Updated Nov 2, 2026

Details
2× DGX Spark
42.6tok/sEveryday

1 request, prose prompt, with DSpark (per recipe) Source 

Intelligence40with thinkingno thinking 25Original model's value. Heavily compressed (~2 bit), intelligence is likely much lower.
  • ≤ 3 bit: quantization may cost quality
  • Experimental
  • Custom kernel required

EXL3 2.0 bpw MCG (routed experts, tail-biting Viterbi re-encoded, scale refit), lm_head MXFP8, KV fp8 (8-GiB-Pin), DSpark-3vLLMWeights Repo Updated Sep 27, 2026

Details

← Back to overview

Local AI in your company?

In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.