Local AI · Recipe · 1× DGX Spark

Qwen3.6-35B-A3B NVFP4 with vLLM on 1× DGX Spark (64k context)

by r0b0tlab

79.7tok/sMixed

1 request, mixed prompt set, with MTP (per recipe)

Source: github.com
Intelligence (original model) · Artificial Analysis18with thinkingno thinking 15

Engine

Engine
vLLM 0.24.1-dev
Quantization
NVFP4 experts + FP8 dense (compressed-tensors) + FP8 KV
Model family
Qwen3.6-35B-A3B
Context
65,536
Parameters
35B total / 3B active MoE
Creator
r0b0tlab
GitHub stars
7
Repo updated
Jul 10, 2026

Measurements

Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.

No sourced measurements for this recipe.

What you need

Hardware
1 × NVIDIA DGX Spark (GB10)
Weights
Engine
vLLM 0.24.1-dev
Context
65,536 tokens

Related recipes

← Back to overview

Local AI in your company?

In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.