---
type: "Article"
title: "GLM-5.3 753B EXL3 2.75 bpw with TensorFold on 3× DGX Spark"
description: "GLM-5.3 753B EXL3 2.75 bpw with TensorFold on 3× DGX Spark: recipe by MiaAI-Lab with speed, condition and source for every number, weights and license."
resource: "https://www.contextstudios.ai/local-ai/miaai-lab--glm-5.3-exl3-3x-dgx-sparks-tensorfold"
language: "en"
generated:
  by: "process:contextstudios-md/1"
  at: "2026-10-24T16:15:58.868Z"
status: "stable"
---

# GLM-5.3 753B EXL3 2.75 bpw with TensorFold on 3× DGX Spark

GLM-5.3 753B EXL3 2.75 bpw with TensorFold on 3× DGX Spark: 31.3 tok/s according to github.com (dataset as of Sep 29, 2026).

- Creator: [MiaAI-Lab](https://www.contextstudios.ai/local-ai/creators/miaai-lab.md)
- Engine: TensorFold v0.6.0 + 110 Patches, Image ghcr.io/miaai-lab/glm-5.3-exl3-3x-dgx-sparks-tensorfold:v0.6.0-4f3223245926, DSpark + Copy-Drafts, Context Parallelism, RoCE
- Quantization: EXL3 2,75 bpw Ø (Experten 2–4 bit), 4-bit dense, BF16 sonst, FP4 KV (Default CP=1)
- Model family: GLM-5.3
- Hardware: dgx-spark x3
- Context: 499712
- Artificial Analysis Intelligence Index: 44.8 ([source](https://artificialanalysis.ai/models/glm-5-3))

## All numbers

- 31.3 tok/s (Everyday; Everyday, 1 request, prose prompt, with DSpark (per recipe)) — [source](https://github.com/MiaAI-Lab/GLM-5.3-EXL3-3x-DGX-Sparks-TensorFold#performance)
- decode_tps: 31.3 (1 request) — [source](https://github.com/MiaAI-Lab/GLM-5.3-EXL3-3x-DGX-Sparks-TensorFold#performance)
- decode_tps: 48.2 (4 parallel requests) — [source](https://github.com/MiaAI-Lab/GLM-5.3-EXL3-3x-DGX-Sparks-TensorFold#concurrent-requests-0134-0138-0139)
- prefill_tps: 606.5 (1 request) — [source](https://github.com/MiaAI-Lab/GLM-5.3-EXL3-3x-DGX-Sparks-TensorFold#performance)

## Weights

- [Mia-AiLab/GLM-5.3-EXL3-2.75bpw-TensorFold](https://huggingface.co/Mia-AiLab/GLM-5.3-EXL3-2.75bpw-TensorFold) (main, other)
- [RedHatAI/GLM-5.3-speculator.dspark](https://huggingface.co/RedHatAI/GLM-5.3-speculator.dspark) (draft, other)
- [zai-org/GLM-5.3](https://huggingface.co/zai-org/GLM-5.3) (base, other)

[https://github.com/MiaAI-Lab/GLM-5.3-EXL3-3x-DGX-Sparks-TensorFold](https://github.com/MiaAI-Lab/GLM-5.3-EXL3-3x-DGX-Sparks-TensorFold)

## Related

- [Local AI on your hardware.](https://www.contextstudios.ai/local-ai.md)
