Local AI · Recipe · 1× DGX Spark

Laguna-XS-2.1 33B NVFP4 with vLLM on 1× DGX Spark

by r0b0tlab

43.8tok/sMixed

1 request, mixed prompt set, no speculative decoding

Source: github.com
Intelligence (original model) · Artificial Analysisno independent value

Engine

Engine
vLLM v0.24.0
Quantization
NVFP4 (compressed-tensors) + FP8 KV
Model family
Laguna-XS-2.1
Context
32,768
Parameters
33B total / 3B active MoE
Creator
r0b0tlab
GitHub stars
0
Repo updated
Jul 4, 2026

Measurements

Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.

No sourced measurements for this recipe.

What you need

Hardware
1 × NVIDIA DGX Spark (GB10)
Weights
Engine
vLLM v0.24.0
Context
32,768 tokens

Related recipes

← Back to overview

Local AI in your company?

In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.