Local AI · Recipe · 2× DGX Spark

DeepSeek-V4.1-Flash Q2 with DwarfStar on 2× DGX Spark

by antirez

21.9tok/sPeak

1 request, best value reported by source, context 1024

Source: github.com
Intelligence (original model) · Artificial Analysis40with thinkingno thinking 25

≤ 3 bit: quantization may cost quality

Engine

Engine
DwarfStar (ds4) main@0aaea5a (2026-09-20)
Quantization
Q2 (imatrix), Experten hälftig je Spark; vollständige GGUF auf beiden SSDs
Model family
DeepSeek-V4.1-Flash
Context
65,536
Creator
antirez
GitHub stars
22,692
Repo updated
Sep 20, 2026

Measurements

Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.

No sourced measurements for this recipe.

What you need

Hardware
2 × NVIDIA DGX Spark (GB10)
Engine
DwarfStar (ds4) main@0aaea5a (2026-09-20)
Context
65,536 tokens

Notes

What matters before you rebuild it.

  • ≤ 3 bit: quantization may cost qualityAt 3 bit and below the model may answer noticeably worse than the original. The intelligence number refers to the original.

Sources

Related recipes

← Back to overview

Local AI in your company?

In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.