Local AI · Recipe · 1× DGX Spark

DeepSeek-V4.1-Flash Q2 with DwarfStar on 1× DGX Spark

by antirez

No speed value is documented for this recipe, so this page is not indexed.

Intelligence (original model) · Artificial Analysis40with thinkingno thinking 25

≤ 3 bit: quantization may cost quality

Engine

Engine
DwarfStar (ds4) main@0aaea5a (2026-09-20)
Quantization
Q2 (imatrix), 341-GiB-Datei inkl. 189 GiB Disk-Engram-Tabellen
Model family
DeepSeek-V4.1-Flash
Context
32,768
Creator
antirez
GitHub stars
24,199
Repo updated
Nov 2, 2026

Measurements

Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.

Prefill by context

  • 32K384 tok/sSeparater Lauf mit 64-GiB-Cache-Budget, 64K alloziert, 32K initialer Prefill Source 

What you need

Hardware
1 × NVIDIA DGX Spark (GB10)
Engine
DwarfStar (ds4) main@0aaea5a (2026-09-20)
Context
32,768 tokens

Notes

What matters before you rebuild it.

  • ≤ 3 bit: quantization may cost qualityAt 3 bit and below the model may answer noticeably worse than the original. The intelligence number refers to the original.
  • Streams from SSD

Sources

Related recipes

8× DGX Spark
74tok/sEveryday

1 request, generation at 32K context (speed table, ring of eight), thinking on, high, with DSpark (per recipe); experimental profile Source 

  • Custom kernel required
  • Experimental

Stock-Checkpoint FP8/MXFP4 (DeepSeek)vLLM (local-inference-lab Fork) via SparkRing (SIRCL-Collectives, switchless RDMA ueber ConnectX-7), Image Release 2026.10.2Weights Repo Updated Nov 2, 2026

Details

← Back to overview

Local AI in your company?

In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.