Local AI · Recipe · 4× RTX PRO 6000

DeepSeek-V4.1-Flash with vLLM on 4× RTX PRO 6000

DeepSeek-V4.1-Flash with vLLM on 4× RTX PRO 6000: 202 tok/s according to github.com (dataset as of Nov 3, 2026).

by 0xSero

202tok/sPeak

1 request, best value reported by source, context 200k

Source: github.com
Intelligence (original model) · Artificial Analysis40with thinkingno thinking 25

Engine

Engine
vLLM
Quantization
native Gewichte, modell-native komprimierte KV
Model family
DeepSeek-V4.1-Flash
Context
1,048,576
Creator
0xSero
GitHub stars
86
Repo updated
Oct 17, 2026

Measurements

Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.

Decode · 1 request

Prefill by context

What you need

Hardware
4 × NVIDIA RTX PRO 6000 Blackwell
Engine
vLLM
Context
1,048,576 tokens

Notes

What matters before you rebuild it.

  • Experimental

Sources

Related recipes

8× DGX Spark
74tok/sEveryday

1 request, generation at 32K context (speed table, ring of eight), thinking on, high, with DSpark (per recipe); experimental profile Source 

  • Custom kernel required
  • Experimental

Stock-Checkpoint FP8/MXFP4 (DeepSeek)vLLM (local-inference-lab Fork) via SparkRing (SIRCL-Collectives, switchless RDMA ueber ConnectX-7), Image Release 2026.10.2Weights Repo Updated Nov 2, 2026

Details

← Back to overview

Local AI in your company?

In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.