---
type: "Article"
title: "GLM-5.3 EXL3 3.0 bpw with TensorFold on 4× DGX Spark"
description: "GLM-5.3 EXL3 3.0 bpw with TensorFold on 4× DGX Spark: recipe by bertholomus with speed, condition and source for every number, weights and license."
resource: "https://www.contextstudios.ai/local-ai/bertholomus--glm-5.3-exl3-3.0bpw-tensorfold-4x-dgx-spark"
language: "en"
generated:
  by: "process:contextstudios-md/1"
  at: "2026-11-11T03:20:32.917Z"
status: "stable"
---

# GLM-5.3 EXL3 3.0 bpw with TensorFold on 4× DGX Spark

GLM-5.3 EXL3 3.0 bpw with TensorFold on 4× DGX Spark: ~36 tok/s according to github.com (dataset as of Nov 3, 2026).

- Creator: [bertholomus](https://www.contextstudios.ai/local-ai/creators/bertholomus.md)
- Engine: TensorFold 0.6.0 + bertholomus glm-dsa-tp4 branch (release numbers on 3eb35dd, head ddfad35), image nvcr.io/nvidia/pytorch:26.07-py3, TP4 over direct RoCE, MTP-3 drafting, config B (1M window, DCP4, --parallel 4)
- Quantization: EXL3 3.0 bpw (exllamav3 1.5.3; routed experts 3.0, attention/shared/dense ~5, MTP experts 4, lm_head 6; 3.04 bpw avg), Q5 latent cache
- Model family: GLM-5.3
- Hardware: dgx-spark x4
- Context: 1048576
- Artificial Analysis Intelligence Index: 44.8 ([source](https://artificialanalysis.ai/models/glm-5-3))

## All numbers

- ~36 tok/s (Peak; Peak, 1 request, prompt type not stated, range 33–39 tok/s, with MTP-3 (per recipe)) — [source](https://github.com/bertholomus/glm-5.3-tensorfold-tp4-4xgb10#release-numbers-2026-10-04-branch-glm-dsa-tp4--3eb35dd-4-gb10-greedy-mtp-3)
- decode_tps: 36 (1 request) — [source](https://github.com/bertholomus/glm-5.3-tensorfold-tp4-4xgb10#release-numbers-2026-10-04-branch-glm-dsa-tp4--3eb35dd-4-gb10-greedy-mtp-3)
- prefill_tps: 402 (1 request) — [source](https://github.com/bertholomus/glm-5.3-tensorfold-tp4-4xgb10#release-numbers-2026-10-04-branch-glm-dsa-tp4--3eb35dd-4-gb10-greedy-mtp-3)

## Weights

- [bertholomus/GLM-5.3-EXL3-3.0bpw](https://huggingface.co/bertholomus/GLM-5.3-EXL3-3.0bpw) (main, other)
- [zai-org/GLM-5.3](https://huggingface.co/zai-org/GLM-5.3) (base, other)

[https://github.com/bertholomus/glm-5.3-tensorfold-tp4-4xgb10](https://github.com/bertholomus/glm-5.3-tensorfold-tp4-4xgb10)

## Related

- [Local AI on your hardware.](https://www.contextstudios.ai/local-ai.md)