Local AI · Recipe · 3× DGX Spark

DeepSeek-V4.1-Flash 763B MXFP4 with SGLang on 3× DGX Spark

DeepSeek-V4.1-Flash 763B MXFP4 with SGLang on 3× DGX Spark: 51 tok/s according to github.com (dataset as of Nov 3, 2026).

by MiaAI-Lab

51tok/sEveryday

1 request, prose prompt, with MTP/EAGLE (spekulativ, ~59 ms/step) (per recipe)

Source: github.com
Intelligence (original model) · Artificial Analysis40with thinkingno thinking 25

Engine

Engine
SGLang
Quantization
native MXFP4 experts + FP8 dense
Model family
DeepSeek-V4.1-Flash
Context
262,144
Parameters
~763B
Creator
MiaAI-Lab
GitHub stars
281
Repo updated
Oct 17, 2026

Measurements

Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.

Decode · 1 request

  • Everyday (decode)51 tok/sProse, 3 Sparks, TTFT 223 ms Source 
  • Peak (decode)51 tok/sProse, 3 Sparks, TTFT 223 ms Source 

What you need

Hardware
3 × NVIDIA DGX Spark (GB10)
Engine
SGLang
Context
262,144 tokens

Related recipes

8× DGX Spark
74tok/sEveryday

1 request, generation at 32K context (speed table, ring of eight), thinking on, high, with DSpark (per recipe); experimental profile Source 

  • Custom kernel required
  • Experimental

Stock-Checkpoint FP8/MXFP4 (DeepSeek)vLLM (local-inference-lab Fork) via SparkRing (SIRCL-Collectives, switchless RDMA ueber ConnectX-7), Image Release 2026.10.2Weights Repo Updated Nov 2, 2026

Details
2× DGX Spark
42.6tok/sEveryday

1 request, prose prompt, with DSpark (per recipe) Source 

Intelligence40with thinkingno thinking 25Original model's value. Heavily compressed (~2 bit), intelligence is likely much lower.
  • ≤ 3 bit: quantization may cost quality
  • Experimental
  • Custom kernel required

EXL3 2.0 bpw MCG (routed experts, tail-biting Viterbi re-encoded, scale refit), lm_head MXFP8, KV fp8 (8-GiB-Pin), DSpark-3vLLMWeights Repo Updated Sep 27, 2026

Details

← Back to overview

Local AI in your company?

In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.