---
type: "Article"
title: "Ling-3.1-Flash-1019 EXL3 3.03 bpw with TensorFold on 2× DGX Spark"
description: "Ling-3.1-Flash-1019 EXL3 3.03 bpw with TensorFold on 2× DGX Spark: recipe by bertholomus with speed, condition and source for every number, weights and license."
resource: "https://www.contextstudios.ai/local-ai/bertholomus--ling-3.1-flash-1019-exl3-3.03bpw-tensorfold-2x-dgx-spark"
language: "en"
generated:
  by: "process:contextstudios-md/1"
  at: "2026-11-11T03:30:10.186Z"
status: "stable"
---

# Ling-3.1-Flash-1019 EXL3 3.03 bpw with TensorFold on 2× DGX Spark

Ling-3.1-Flash-1019 EXL3 3.03 bpw with TensorFold on 2× DGX Spark: ~38.2 tok/s according to github.com (dataset as of Nov 3, 2026).

- Creator: [bertholomus](https://www.contextstudios.ai/local-ai/creators/bertholomus.md)
- Engine: TensorFold (bertholomus fork, branch ling-3.1-tp2 @ 72f16e48, bailing_v3 family on TensorFold v0.6.6 CUDA engine), image nvcr.io/nvidia/pytorch:26.07-py3, TP2 over direct RoCE, MTP drafting (adaptive depth)
- Quantization: EXL3 3.03 bpw (routed experts 3, shared experts 5, KDA attention 4, dense MLP 4, MLA attention 6, head 6, MTP layer 4)
- Model family: Ling-3.1-Flash-1019
- Hardware: dgx-spark x2
- Context: 262144

## All numbers

- ~38.2 tok/s (Peak; Best value reported by source, 1 request, prompt type not stated, 2,222 prompt tokens, range 37.7–38.7 tok/s, with MTP (per recipe)) — [source](https://github.com/bertholomus/ling-3.1-tensorfold-tp2-2xgb10#v020-2026-10-28-ling-31-flash-1019-with-its-native-262k-window)
- decode_tps: 38.2 (1 request) — [source](https://github.com/bertholomus/ling-3.1-tensorfold-tp2-2xgb10#v020-2026-10-28-ling-31-flash-1019-with-its-native-262k-window)
- prefill_tps: 568 (1 request) — [source](https://github.com/bertholomus/ling-3.1-tensorfold-tp2-2xgb10#v020-2026-10-28-ling-31-flash-1019-with-its-native-262k-window)

## Weights

- [bertholomus/Ling-3.1-flash-1019-EXL3-3.03bpw](https://huggingface.co/bertholomus/Ling-3.1-flash-1019-EXL3-3.03bpw) (main, mit)
- [inclusionAI/Ling-3.1-flash-1019](https://huggingface.co/inclusionAI/Ling-3.1-flash-1019) (base, mit)

[https://github.com/bertholomus/ling-3.1-tensorfold-tp2-2xgb10](https://github.com/bertholomus/ling-3.1-tensorfold-tp2-2xgb10)

## Related

- [Local AI on your hardware.](https://www.contextstudios.ai/local-ai.md)
