---
type: "Article"
title: "Nemotron-3.5-Super-VL 120B-A12B NVFP4 with vLLM on 1× DGX Spark"
description: "Nemotron-3.5-Super-VL 120B-A12B NVFP4 with vLLM on 1× DGX Spark: recipe by sfxnz with speed, condition and source for every number, weights and license."
resource: "https://www.contextstudios.ai/local-ai/sfxnz--nemotron-35-super-vl-120b-a12b-nvfp4-lilicorr-1x-dgx-spark"
language: "en"
generated:
  by: "process:contextstudios-md/1"
  at: "2026-11-17T02:08:21.657Z"
status: "stable"
---

# Nemotron-3.5-Super-VL 120B-A12B NVFP4 with vLLM on 1× DGX Spark

Nemotron-3.5-Super-VL 120B-A12B NVFP4 with vLLM on 1× DGX Spark: 48 tok/s according to github.com (dataset as of Nov 3, 2026).

- Creator: [sfxnz](https://www.contextstudios.ai/local-ai/creators/sfxnz.md)
- Engine: vLLM 0.32.0rc1 (nightly 3f1bcfd8, pinned vllm/vllm-openai@sha256:cb9bc64f…), LiLiCorr speculative decoding (dflash, 7 tokens), fastsafetensors
- Quantization: NVFP4 experts, FP8 Mamba projections and attention, FP8 KV
- Model family: Nemotron-3.5-Super-VL-120B-A12B
- Hardware: dgx-spark x1
- Context: 1048576

## All numbers

- 48 tok/s (Mixed; Mixed, 1 request, mixed prompt set (SPEED-Bench), greedy, thinking off, with LiLiCorr (per recipe)) — [source](https://github.com/sfxnz/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4-DGX-SPARK#measured-on-1-dgx-spark)
- decode_tps: 48 (1 request) — [source](https://github.com/sfxnz/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4-DGX-SPARK#measured-on-1-dgx-spark)
- decode_tps: 189 (32 parallel requests) — [source](https://github.com/sfxnz/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4-DGX-SPARK#measured-on-1-dgx-spark)
- prefill_tps: 2466 (1 request) — [source](https://github.com/sfxnz/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4-DGX-SPARK#measured-on-1-dgx-spark)
- ttft_ms: 400 (1 request) — [source](https://github.com/sfxnz/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4-DGX-SPARK#measured-on-1-dgx-spark)

## Weights

- [nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4](https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4) (main, other)
- [nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4-LiLiCorr](https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4-LiLiCorr) (draft, other)

[https://github.com/sfxnz/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4-DGX-SPARK](https://github.com/sfxnz/NVIDIA-Nemotron-3.5-Super-VL-120B-A12B-NVFP4-DGX-SPARK)

## Related

- [Local AI on your hardware.](https://www.contextstudios.ai/local-ai.md)
