2× DGX Spark
19.4tok/sEveryday
1 request, essay prompt, with MTP (per recipe) Source
Intelligence25with thinking
- Restrictive license
- License unclear
Local AI · Recipe · 2× DGX Spark
Hy3 295B NVFP4 with vLLM on 2× DGX Spark
by tonyd2wild
Intelligence (original model) · Artificial Analysisno independent value
Engine
- Engine
- vLLM 0.23.1rc1.dev190
- Quantization
- NVFP4-W4A16 + FP8 KV
- Model family
- Hy3
- Context
- 131,072
- Parameters
- 295B MoE
- Creator
- tonyd2wild
- GitHub stars
- 19
- Repo updated
- Aug 27, 2026
Measurements
Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.
No sourced measurements for this recipe.
What you need
- Hardware
- 2 × NVIDIA DGX Spark (GB10)
- Weights
- Main weightskodelow/Hy3-NVFP4-W4A16 Apache-2.0
- Engine
- vLLM 0.23.1rc1.dev190
- Context
- 131,072 tokens
Related recipes
2× DGX Spark
22.3tok/sPeak
1 request, best value reported by source Source
Intelligence25with thinking
- Restrictive license
- License unclear
2× DGX Spark
54.4tok/sEveryday
1 request, prose prompt, with MTP (per recipe) Source
Intelligence40with thinking
- Access on request
- License unclear
2× DGX Spark
36.1tok/sEveryday
1 request, prose prompt, with DFlash2 (per recipe) Source
Intelligence42with thinking
- ≤ 3 bit: quantization may cost quality
- Custom kernel required
- Non-commercial
- License unclear
2× DGX Spark
35tok/sEveryday
1 request, prose prompt, with EAGLE Source
Intelligenceno independent value
- Experimental
2× DGX Spark
33.2tok/sEveryday
1 request, prose prompt, with DSpark (per recipe) Source
Intelligenceno independent value
- Custom kernel required
Local AI in your company?
In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.