EN
Book a call

Local AI · Recipe · 4× DGX Spark

Swift-1.5-Qwen3.8-Flash-Next NVFP4 with SparkRing on 4× DGX Spark

Swift-1.5-Qwen3.8-Flash-Next NVFP4 with SparkRing on 4× DGX Spark: 64.7 tok/s according to github.com (dataset as of Sep 29, 2026).

by fujitsupolycom

64.7tok/sEveryday

1 request, decode at 16K context (profile table), thinking on, xhigh

Source: github.com
Intelligence (original model) · Artificial Analysisno independent value
Instructions in the README Repo

Engine

Engine
vLLM (local-inference-lab Fork) via SparkRing (switchless NCCL ueber ConnectX-7)
Quantization
NVFP4-Experten/BF16 (UkisAI)
Model family
Swift-1.5-Qwen3.8-Flash-Next
Context
—
Parameters
119,6 GB Safetensors
Creator
fujitsupolycom
GitHub stars
91
Repo updated
Oct 6, 2026

Measurements

Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.

Decode · 1 request

  • Everyday (decode)64.7 tok/scontext 16K · 1 Nutzer, je 16K Kontext; Thinking on, xhigh Source 

Decode · parallel requests

Sums over all streams are marked; per request it is correspondingly less.

  • 16 parallel requests340 tok/sPeak (decode) · context 16K · Thinking on, xhigh Source 

Prefill by context

What you need

Hardware
4 × NVIDIA DGX Spark (GB10)
Engine
vLLM (local-inference-lab Fork) via SparkRing (switchless NCCL ueber ConnectX-7)

Notes

What matters before you rebuild it.

  • Custom kernel required

Sources

Related recipes

← Back to overview

Local AI in your company?

In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.

See the AI workshopBack to overview