2× DGX Spark
33tok/sMixed
1 request, mixed prompt set, with MTP (per recipe) Source
Intelligence28with thinking
- No license
Local AI · Recipe · 2× DGX Spark
Inkling-Small 156B NVFP4 with vLLM on 2× DGX Spark
by tonyd2wild
No speed value is documented for this recipe, so this page is not indexed.
Engine
- Engine
- vLLM
- Quantization
- NVFP4 + BF16 KV
- Model family
- Inkling-Small
- Context
- 262,144
- Parameters
- ~156B (HF safetensors)
- Creator
- tonyd2wild
- GitHub stars
- 6
- Repo updated
- Jul 31, 2026
Measurements
Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.
No sourced measurements for this recipe.
What you need
- Hardware
- 2 × NVIDIA DGX Spark (GB10)
- Weights
- Main weightsthinkingmachines/Inkling-Small-NVFP4 Apache-2.0
- Draft modelRadixArk/Inkling-Small-DSpark-Preview License unclear
- Engine
- vLLM
- Context
- 262,144 tokens
Notes
What matters before you rebuild it.
- Experimental
- License unclear
Sources
Related recipes
2× DGX Spark
33tok/sPeak
1 request, best value reported by source, context 1m Source
Intelligence28with thinking
- Custom kernel required
- License unclear
2× DGX Spark
16tok/sPeak
1 request, mixed prompt set Source
Intelligence28with thinking
2× DGX Spark
54.4tok/sEveryday
1 request, prose prompt, with MTP (per recipe) Source
Intelligence40with thinking
- Access on request
- License unclear
2× DGX Spark
36.1tok/sEveryday
1 request, prose prompt, with DFlash2 (per recipe) Source
Intelligence42with thinking
- ≤ 3 bit: quantization may cost quality
- Custom kernel required
- Non-commercial
- License unclear
2× DGX Spark
35tok/sEveryday
1 request, prose prompt, with EAGLE Source
Intelligenceno independent value
- Experimental
Local AI in your company?
In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.