2× DGX Spark
33tok/sMixed
1 request, mixed prompt set, with MTP (per recipe) Source
Intelligence28with thinking
- No license
Local AI · Recipe · 2× DGX Spark
Inkling-Small 156B NVFP4 with vLLM on 2× DGX Spark
by tonyd2wild
No speed value is documented for this recipe, so this page is not indexed.
Engine
- Engine
- vLLM
- Quantization
- NVFP4 + BF16 KV
- Model family
- Inkling-Small
- Context
- 262,144
- Parameters
- ~156B (HF safetensors)
- Creator
- tonyd2wild
- GitHub stars
- 6
- Repo updated
- Jul 31, 2026
Measurements
Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.
No sourced measurements for this recipe.
What you need
- Hardware
- 2 × NVIDIA DGX Spark (GB10)
- Weights
- Main weightsthinkingmachines/Inkling-Small-NVFP4 Apache-2.0
- Draft modelRadixArk/Inkling-Small-DSpark-Preview License unclear
- Engine
- vLLM
- Context
- 262,144 tokens
Notes
What matters before you rebuild it.
- Experimental
- License unclear
Sources
Related recipes
2× DGX Spark
33tok/sPeak
1 request, best value reported by source, context 1m Source
Intelligence28with thinking
- Custom kernel required
- License unclear
2× DGX Spark
16tok/sPeak
1 request, mixed prompt set Source
Intelligence28with thinking
2× DGX Spark
89.3tok/sEveryday
1 request, prose prompt, with MTP (per recipe) Source
Intelligenceno independent value
- Custom kernel required
- License unclear
2× DGX Spark
74tok/sEveryday
1 request, prose prompt (long story), thinking off, with MTP Source
Intelligence40with thinking
- Custom kernel required
- License unclear
2× DGX Spark
69.6tok/sEveryday
1 request, prose prompt, with MTP (per recipe) Source
Intelligence40with thinking
- License unclear
Local AI in your company?
In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.