---
type: "Article"
title: "Nemotron-3.5-Bolt 74B-A9B 24GB pack with TensorFold on 1× DGX Spark"
description: "Nemotron-3.5-Bolt 74B-A9B 24GB pack with TensorFold on 1× DGX Spark: recipe by MiaAI-Lab with speed, condition and source for every number, weights and license."
resource: "https://www.contextstudios.ai/local-ai/miaai-lab--nemotron-3.5-bolt-74b-a9b-24gb-tensorfold-dgx-spark"
language: "en"
generated:
  by: "process:contextstudios-md/1"
  at: "2026-11-10T13:05:54.907Z"
status: "stable"
---

# Nemotron-3.5-Bolt 74B-A9B 24GB pack with TensorFold on 1× DGX Spark

Nemotron-3.5-Bolt 74B-A9B 24GB pack with TensorFold on 1× DGX Spark: 71.8 tok/s according to github.com (dataset as of Nov 3, 2026).

- Creator: [MiaAI-Lab](https://www.contextstudios.ai/local-ai/creators/miaai-lab.md)
- Engine: TensorFold tensorfold-native v1.1.6 (eea9dc9c) + recipe patches/ (Bolt lane backend, libbolt.so CUDA forward pass), LiLiCorr drafts
- Quantization: 24GB pack: IQ2_XXS experts (2.0625 bits), NVFP4 Mamba projections, Q8_0 attention/latent projections/lm_head; bf16 KV
- Model family: Nemotron-3.5-Bolt-74B-A9B
- Hardware: dgx-spark x1
- Context: 262144

## All numbers

- 71.8 tok/s (Everyday; Everyday, 1 request, prose prompt (sampled, thinking off), with LiLiCorr (per recipe)) — [source](https://github.com/MiaAI-Lab/Nemotron-3.5-Bolt-TensorFold-DGX-Spark#speed)
- decode_tps: 71.8 (1 request) — [source](https://github.com/MiaAI-Lab/Nemotron-3.5-Bolt-TensorFold-DGX-Spark#speed)
- decode_tps: 137.4 (1 request) — [source](https://github.com/MiaAI-Lab/Nemotron-3.5-Bolt-TensorFold-DGX-Spark#speed)
- prefill_tps: 2485 (1 request) — [source](https://github.com/MiaAI-Lab/Nemotron-3.5-Bolt-TensorFold-DGX-Spark#speed)

## Weights

- [nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB](https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB) (main, other)
- [nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB-LiLiCorr](https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GB-LiLiCorr) (draft, other)

[https://github.com/MiaAI-Lab/Nemotron-3.5-Bolt-TensorFold-DGX-Spark](https://github.com/MiaAI-Lab/Nemotron-3.5-Bolt-TensorFold-DGX-Spark)

## Related

- [Local AI on your hardware.](https://www.contextstudios.ai/local-ai.md)