EN
Book a call

Local AI · Recipe · 2× DGX Spark

DeepSeek-V4.1-Flash 763B EXL3 2.9 bpw with vLLM on 2× DGX Spark

by drowzeys

31.6tok/sEveryday

1 request, prose prompt, with DSpark (per recipe)

Source: github.com
Intelligence (original model) · Artificial Analysis40with thinkingno thinking 25

≤ 3 bit: quantization may cost quality

Instructions in the README Repo

Engine

Engine
vLLM
Quantization
EXL3 mul1 2.9 bpw (per-tensor K), fp8_ds_mla KV
Model family
DeepSeek-V4.1-Flash
Context
600,000
Parameters
763B MoE
Creator
drowzeys
GitHub stars
0
Repo updated
Sep 14, 2026

Measurements

Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.

No sourced measurements for this recipe.

What you need

Hardware
2 × NVIDIA DGX Spark (GB10)
Engine
vLLM
Context
600,000 tokens

Notes

What matters before you rebuild it.

  • ≤ 3 bit: quantization may cost qualityAt 3 bit and below the model may answer noticeably worse than the original. The intelligence number refers to the original.
  • Fork
  • Custom kernel required

Sources

Related recipes

← Back to overview

Local AI in your company?

In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.

See the AI workshopBack to overview