2× DGX Spark
33tok/sMixed
1 request, mixed prompt set, with MTP (per recipe) Source
Intelligence28with thinking
- No license
Local AI · Recipe · 2× DGX Spark
Inkling-Small 276B-A12B NVFP4 with SGLang on 2× DGX Spark
by drowzeys
Engine
- Engine
- SGLang
- Quantization
- NVFP4 weights + NVFP4 KV (eigener Port)
- Model family
- Inkling-Small
- Context
- 1,048,576
- Parameters
- 276B MoE / 12B active
- Creator
- drowzeys
- GitHub stars
- 10
- Repo updated
- Aug 17, 2026
Measurements
Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.
No sourced measurements for this recipe.
What you need
- Hardware
- 2 × NVIDIA DGX Spark (GB10)
- Weights
- Main weightsthinkingmachines/Inkling-Small-NVFP4 Apache-2.0
- Draft modelRadixArk/Inkling-Small-DSpark-Preview License unclear
- Engine
- SGLang
- Context
- 1,048,576 tokens
Notes
What matters before you rebuild it.
- Custom kernel required
- License unclear
Sources
Related recipes
2× DGX Spark
16tok/sPeak
1 request, mixed prompt set Source
Intelligence28with thinking
2× DGX Spark
no documented speed
Intelligence28with thinking
- Experimental
- License unclear
2× DGX Spark
54.4tok/sEveryday
1 request, prose prompt, with MTP (per recipe) Source
Intelligence40with thinking
- Access on request
- License unclear
2× DGX Spark
36.1tok/sEveryday
1 request, prose prompt, with DFlash2 (per recipe) Source
Intelligence42with thinking
- ≤ 3 bit: quantization may cost quality
- Custom kernel required
- Non-commercial
- License unclear
2× DGX Spark
35tok/sEveryday
1 request, prose prompt, with EAGLE Source
Intelligenceno independent value
- Experimental
Local AI in your company?
In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.