---
type: "Article"
title: "GLM-5.3-Flash NVFP4 (NVIDIA) with vLLM (glm53-sm121-v13) on 2× DGX Spark (vision)"
description: "GLM-5.3-Flash NVFP4 (NVIDIA) with vLLM (glm53-sm121-v13) on 2× DGX Spark (vision): recipe by sfxnz with speed, condition and source for every number, weights and license."
resource: "https://www.contextstudios.ai/local-ai/sfxnz--glm53-flash-nvidia-nvfp4-dflash2-v13-2x-dgx-spark"
language: "en"
generated:
  by: "process:contextstudios-md/1"
  at: "2026-11-11T03:20:32.594Z"
status: "stable"
---

# GLM-5.3-Flash NVFP4 (NVIDIA) with vLLM (glm53-sm121-v13) on 2× DGX Spark (vision)

GLM-5.3-Flash NVFP4 (NVIDIA) with vLLM (glm53-sm121-v13) on 2× DGX Spark (vision): 30 tok/s according to github.com (dataset as of Nov 3, 2026).

- Creator: [sfxnz](https://www.contextstudios.ai/local-ai/creators/sfxnz.md)
- Engine: vLLM (Image glm53-sm121-v13, lokal gebaute Kette v8→v13 auf vllm/vllm-openai:glm53-flash-arm64-cu130), TP=2 über RoCE, DFlash2-7 mit Adaptive Verify (tau 0,3), CUDA Graphs
- Quantization: Offizielles NVIDIA-ModelOpt-0.47.0-NVFP4 W4A4 (Routed Experts + Dense-MLP, Marlin) @09b04e5e; INT8 W8A16 g128 auf shared/mla/kda_o/kda_in/lm_head; fp8_e4m3 KV (4,14-GiB-Pin); DFlash2-7-Drafter in NVFP4 W4A16
- Model family: GLM-5.3-Flash
- Hardware: dgx-spark x2
- Context: 327680
- Artificial Analysis Intelligence Index: 41.8 ([source](https://artificialanalysis.ai/models/glm-5-3-flash))

## All numbers

- 30 tok/s (Everyday; Everyday, 1 request, prose prompt, with DFlash2 (per recipe)) — [source](https://github.com/sfxnz/GLM-5.3-Flash-NVFP4-vLLM-2x-DGX-Spark#measured-on-2-dgx-spark-lail-lab)
- decode_tps: 30.04 (1 request) — [source](https://github.com/sfxnz/GLM-5.3-Flash-NVFP4-vLLM-2x-DGX-Spark#measured-on-2-dgx-spark-lail-lab)
- decode_tps: 39.43 (2 parallel requests) — [source](https://github.com/sfxnz/GLM-5.3-Flash-NVFP4-vLLM-2x-DGX-Spark#measured-on-2-dgx-spark-lail-lab)
- prefill_tps: 1192 (1 request) — [source](https://github.com/sfxnz/GLM-5.3-Flash-NVFP4-vLLM-2x-DGX-Spark#known-trade-off-long-context-prefill)
- ttft_ms: 260 (1 request) — [source](https://github.com/sfxnz/GLM-5.3-Flash-NVFP4-vLLM-2x-DGX-Spark#measured-on-2-dgx-spark-lail-lab)

## Weights

- [nvidia/GLM-5.3-Flash-NVFP4](https://huggingface.co/nvidia/GLM-5.3-Flash-NVFP4) (main, mit)
- [incoai/GLM-5.3-Flash-DFlash2](https://huggingface.co/incoai/GLM-5.3-Flash-DFlash2) (draft, cc-by-nc-nd-4.0)
- [zai-org/GLM-5.3-Flash](https://huggingface.co/zai-org/GLM-5.3-Flash) (base, mit)

[https://github.com/sfxnz/GLM-5.3-Flash-NVFP4-vLLM-2x-DGX-Spark](https://github.com/sfxnz/GLM-5.3-Flash-NVFP4-vLLM-2x-DGX-Spark)

## Related

- [Local AI on your hardware.](https://www.contextstudios.ai/local-ai.md)