Local AI · Recipe · 2× DGX Spark

Hy3 295B-A21B NVFP4 with vLLM on 2× DGX Spark (no spec)

by drowzeys

22.3tok/sPeak

1 request, best value reported by source

Source: github.com
Intelligence (original model) · Artificial Analysis25with thinking

Engine

Engine
vLLM
Quantization
NVFP4 (compressed-tensors) + turboquant_k8v4 KV bzw. NVFP4 KV
Model family
Hy3
Context
262,144
Parameters
295B MoE / 21B active
Creator
drowzeys
GitHub stars
0
Repo updated
Aug 17, 2026

Measurements

Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.

No sourced measurements for this recipe.

What you need

Hardware
2 × NVIDIA DGX Spark (GB10)
Weights
Engine
vLLM
Context
262,144 tokens

Related recipes

← Back to overview

Local AI in your company?

In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.