---
type: "Article"
title: "Qwen3.8-Flash-Next 125B NVFP4 with vLLM on 4× DGX Spark"
description: "Qwen3.8-Flash-Next 125B NVFP4 with vLLM on 4× DGX Spark: recipe by tonyd2wild with speed, condition and source for every number, weights and license."
resource: "https://www.contextstudios.ai/local-ai/tonyd2wild--qwen3.8-flash-next-nvfp4-dgx-spark-4x"
language: "en"
generated:
  by: "process:contextstudios-md/1"
  at: "2026-10-01T20:41:31.884Z"
status: "stable"
---

# Qwen3.8-Flash-Next 125B NVFP4 with vLLM on 4× DGX Spark

Qwen3.8-Flash-Next 125B NVFP4 with vLLM on 4× DGX Spark: 40.5 tok/s according to github.com (dataset as of Sep 29, 2026).

- Creator: [tonyd2wild](https://www.contextstudios.ai/local-ai/creators/tonyd2wild.md)
- Engine: vLLM nightly 8a728663 + PLE-mmap-Patch
- Quantization: NVFP4 (nvidia), FP8 KV
- Model family: Qwen3.8-Flash-Next
- Hardware: dgx-spark x4
- Context: 262144
- Artificial Analysis Intelligence Index: 39.8 ([source](https://artificialanalysis.ai/models/qwen3-8-flash-next))

## All numbers

- 40.5 tok/s (Mixed; Mixed, 1 request, mixed prompt set, with MTP (per recipe)) — [source](https://github.com/tonyd2wild/Qwen3.8-Flash-Next-NVFP4-DGX-Spark/blob/main/README.md#L129)
- decode_tps: 40.5 (1 request) — [source](https://github.com/tonyd2wild/Qwen3.8-Flash-Next-NVFP4-DGX-Spark/blob/main/README.md#L129)
- decode_tps: 40.5 (1 request) — [source](https://github.com/tonyd2wild/Qwen3.8-Flash-Next-NVFP4-DGX-Spark/blob/main/README.md#L129)
- prefill_tps: 2453 (1 request) — [source](https://github.com/tonyd2wild/Qwen3.8-Flash-Next-NVFP4-DGX-Spark/blob/main/README.md#L129)

## Weights

- [nvidia/Qwen3.8-Flash-Next-NVFP4](https://huggingface.co/nvidia/Qwen3.8-Flash-Next-NVFP4) (main, other)

[https://github.com/tonyd2wild/Qwen3.8-Flash-Next-NVFP4-DGX-Spark](https://github.com/tonyd2wild/Qwen3.8-Flash-Next-NVFP4-DGX-Spark)

## Related

- [Local AI on your hardware.](https://www.contextstudios.ai/local-ai.md)