Local AI · Recipe · 4× DGX Spark

DeepSeek-V4.1-Flash with SGLang on 4× DGX Spark

DeepSeek-V4.1-Flash with SGLang on 4× DGX Spark: 11.2 tok/s according to github.com (dataset as of Nov 3, 2026).

by r0b0tlab

11.2tok/sMixed

1 request, mixed prompt set, with DSpark (per recipe)

Source: github.com
Intelligence (original model) · Artificial Analysis40with thinkingno thinking 25

Engine

Engine
SGLang
Quantization
offizieller Checkpoint (unquantisiert laut REPRODUCIBILITY.md: „does not … quantize the checkpoint“)
Model family
DeepSeek-V4.1-Flash
Context
524,288
Creator
r0b0tlab
GitHub stars
0
Repo updated
Sep 16, 2026

Measurements

Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.

Decode · 1 request

  • Mixed (decode)11.2 tok/sMedium_c1, K5; enthält Prefill Source 
  • Peak (decode)58.3 tok/sCounting_c1 (synthetischer Zähl-Workload, fixed-token), Aggregate output tok/s Source 

Time to first token

Shorter is better.

  • Prompt not stated1,870 mscontext Input ≤128 (zufällig 1–128, ShareGPT) · SGLang bench_serving bench-short-c1, Mean TTFT Source 

What you need

Hardware
4 × NVIDIA DGX Spark (GB10)
Engine
SGLang
Context
524,288 tokens

Related recipes

8× DGX Spark
74tok/sEveryday

1 request, generation at 32K context (speed table, ring of eight), thinking on, high, with DSpark (per recipe); experimental profile Source 

  • Custom kernel required
  • Experimental

Stock-Checkpoint FP8/MXFP4 (DeepSeek)vLLM (local-inference-lab Fork) via SparkRing (SIRCL-Collectives, switchless RDMA ueber ConnectX-7), Image Release 2026.10.2Weights Repo Updated Nov 2, 2026

Details

← Back to overview

Local AI in your company?

In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.