Local AI · Creator

MiaAI-Lab

34 published recipes.

Recipes

2× DGX Spark

Qwen3.8-Flash-Next 125B INT4-AutoRound with TensorFold on 2× DGX Spark (1M context)

by MiaAI-Lab

89.3tok/sEveryday

1 request, prose prompt, with MTP (per recipe) Source

Intelligenceno independent value

Custom kernel required
License unclear

INT4-AutoRound (GPTQ int4, Top-5-Experten) + FP8 n-gram-Tabelle, FP8 KVTensorFold tensorfold-native (Zig, zig-flashnext db281878 + patches), Image ghcr.io/miaai-lab/qwen3.8-flash-dual-dgx-sparks-tensorfold:zig-db28187-f3e1300f4f62, TP=2 über CX7/RoCE, MTP + Copy-Drafts (QUANT=int4ar)Weights Repo Updated Oct 26, 2026

Details

4× DGX Spark

DeepSeek-V4.1-Flash MXFP4 with SGLang on 4× DGX Spark (MiaAI-Lab)

by MiaAI-Lab

87.7tok/sEveryday

1 request, prose prompt, with DSpark (per recipe) Source

Intelligence40with thinking no thinking 25

MXFP4 experts + FP8 dense, Engram-Tabellen auf NVMeSGLangWeights Repo Updated Oct 17, 2026

Details

1× DGX Spark

Nemotron-3.5-Bolt 74B-A9B 24GB pack with TensorFold on 1× DGX Spark

by MiaAI-Lab

71.8tok/sEveryday

1 request, prose prompt (sampled, thinking off), with LiLiCorr (per recipe) Source

Intelligenceno independent value

≤ 3 bit: quantization may cost quality
Custom kernel required
License unclear

24GB pack: IQ2_XXS experts (2.0625 bits), NVFP4 Mamba projections, Q8_0 attention/latent projections/lm_head; bf16 KVTensorFold tensorfold-native v1.1.6 (eea9dc9c) + recipe patches/ (Bolt lane backend, libbolt.so CUDA forward pass), LiLiCorr draftsWeights Repo Updated Nov 1, 2026

Details

2× DGX Spark

Qwen3.8-Flash-Next 125B NVFP4 with TensorFold on 2× DGX Spark (1M context)

by MiaAI-Lab

67.4tok/sEveryday

1 request, prose prompt, with MTP (per recipe) Source

Intelligence40with thinking

Custom kernel required
License unclear

NVFP4 (nvidia, Experten) + FP8 n-gram/MTP, FP8 KVTensorFold tensorfold-native (Zig, zig-flashnext db281878 + patches), Image ghcr.io/miaai-lab/qwen3.8-flash-dual-dgx-sparks-tensorfold:zig-db28187-f3e1300f4f62, TP=2 über CX7/RoCE, MTP + Copy-DraftsWeights Repo Updated Oct 26, 2026

Details

4× DGX Spark

DeepSeek-V4.1-Flash-1017 FP8/MXFP4 with TensorFold on 4× DGX Spark (switchless ring)

by MiaAI-Lab

65.8tok/sEveryday

1 request, prose prompt (T = 0.7, thinking on), with DSpark (per recipe) Source

Intelligenceno independent value

Custom kernel required

FP8 / MXFP4 (official checkpoint as published, no re-quantization)TensorFold native (Zig 0.17.0), BertholomusAI dsv41 family (bertholomus/TensorFold deepseek-v41-zig-tp4 @5940208, kit 6033ea4) + recipe zig/patches, TP4 over a switchless ConnectX-7 ring (./start-switchless.sh), DSpark drafts, CUDA graphsWeights Repo Updated Nov 2, 2026

Details

2× DGX Spark

DeepSeek-V4.1-Flash-1017 EXL3 EAQ 2.9 bpw with TensorFold on 2× DGX Spark

by MiaAI-Lab

63.9tok/sEveryday

1 request, prose prompt (temperature 0.7, thinking on), with DSpark (per recipe) Source

Intelligenceno independent value

≤ 3 bit: quantization may cost quality
Custom kernel required

EXL3 EAQ v1 2.9 bpw (Mia-AiLab; vision tower and DSpark draft blocks included)TensorFold native (Zig 0.17.0), BertholomusAI dsv41 family (bertholomus/TensorFold deepseek-v41-zig @fbbc971) + recipe patches, TP=2 over ConnectX-7 (RoCE), DSpark draftsWeights Repo Updated Nov 2, 2026

Details

2× DGX Spark

GLM-5.3-Flash EXL3 with TensorFold on 2× DGX Spark (1M context, 4 streams)

by MiaAI-Lab

60.4tok/sEveryday

Prose decode, 1 request; quality (FP8 KV, 4-bit dense): GSM8K 98.8% / HumanEval 95.7% / HumanEval+ & MBPP+ 86.5% Source

Intelligence42with thinking

≤ 3 bit: quantization may cost quality
Custom kernel required
Non-commercial
License unclear

EXL3/TR3 4bpw routed experts + 4-bit dense, BF16 elsewhere, FP8 KVTensorFold v0.6.0 + Recipe v1.10 (README: 96 Patches; gepinntes Image v0.6.0-e66c657a433d mit 107 Patches: DFlash2+Copy-Drafts, 4-bit dense, FP8-KV, RoCE-One-Shot-All-Gather, Shared KV-Pool, optionaler Spill-Tier, Vision, Tool-Calling, Anthropic /v1/messages; PARALLEL=8 opt-in)Weights Repo Updated Oct 25, 2026

Details

1× DGX Spark

Qwen3.8 27B MLX 4-bit with TensorFold on 1× DGX Spark

by MiaAI-Lab

58.3tok/sEveryday

1 request, prose prompt, with DFlash2 (per recipe) Source

Intelligence34with thinking no thinking 20

Custom kernel required

MLX affine 4-bit (g64) + FP8 KV, FP8-PrefillTensorFold v0.6.0 (c464617) + 5 Patches, Image ghcr.io/miaai-lab/qwen3.8-27b-dgx-spark-tensorfold:v0.6.0, DFlash2-DraftsWeights Repo Updated Oct 1, 2026

Details

1× DGX Spark

Qwen3.8-Flash-Next NVFP4 (NVIDIA QAD, FP4-Local) with TensorFold on 1× DGX Spark

by MiaAI-Lab

55.6tok/sEveryday

1 request, prose prompt, with MTP (per recipe) Source

Intelligence40with thinking

Custom kernel required
License unclear

NVIDIA FP4-QAD-Export (FP4-Local @b9ce18a6): Routed Experts NVFP4 (Gruppe 16), Attention/Shared Expert MXFP8, alle 512 Experten mit 10 pro Token; n-gram-Tabelle per pread von der SSD; FP8 KVTensorFold tensorfold-native (Zig) v1.1.4 (eab85828) + Patches 0001–0017, Image tensorfold-qwen38:v1.1.4-eab8582 (GHCR v1.1.4-eab8582-4baf16137ecd) auf nvcr.io/nvidia/pytorch:26.07-py3, MTP-DraftsWeights Repo Updated Oct 30, 2026

Details

2× DGX Spark

Qwen3.8-Flash-Next 125B NVFP4 with vLLM on 2× DGX Spark

by MiaAI-Lab

54.4tok/sEveryday

1 request, prose prompt, with MTP (per recipe) Source

Intelligence40with thinking

License unclear

NVFP4 (nvidia) + FP8 KVvLLM vllm/vllm-openai:qwen38-flash-nextWeights Repo Updated Oct 4, 2026

Details

1× DGX Spark

Ornith-1.5-122B EXL3 4 bpw with TensorFold on 1× DGX Spark

by MiaAI-Lab

52.6tok/sEveryday

1 request, prose prompt, with DFlash2 (per recipe) Source

Intelligenceno independent value

Custom kernel required
Experimental

EXL3 EAQ v1 4 bpw (4.049 bpw trellis average per quant card), FP8 KVTensorFold tensorfold-native (Zig 0.17.0, pinned d1018b31 + recipe patches/ for EXL3 in the Qwen3.5-MoE engine), image tensorfold-ornith:zig-d1018b3, DFlash2 draftsWeights Repo Updated Oct 21, 2026

Details

3× DGX Spark

DeepSeek-V4.1-Flash 763B MXFP4 with SGLang on 3× DGX Spark

by MiaAI-Lab

51tok/sEveryday

1 request, prose prompt, with MTP/EAGLE (spekulativ, ~59 ms/step) (per recipe) Source

Intelligence40with thinking no thinking 25

Custom kernel required

native MXFP4 experts + FP8 denseSGLangWeights Repo Updated Oct 17, 2026

Details

3× DGX Spark

DeepSeek-V4-Flash 305B FP8 with vLLM on 3× DGX Spark

by MiaAI-Lab

41.9tok/sEveryday

1 request, prose prompt, with DSpark (per recipe) Source

Intelligenceno independent value

Custom kernel required

Original-Checkpoint (FP8/FP4) , TP3-Head-Pad 64→72vLLM ghcr.io/anemll/dspark-vllm-gx10:0.1.1Weights Repo Updated Oct 4, 2026

Details

3× DGX Spark

GLM-5.3-Flash 320B EXL3 4 bpw with vLLM on 3× DGX Spark

by MiaAI-Lab

40.1tok/sEveryday

1 request, prose prompt, with DFlash2, TR3 weights (per recipe) Source

Intelligence42with thinking

≤ 3 bit: quantization may cost quality
Custom kernel required
Non-commercial
License unclear

EXL3/TR3 4 bpw (routed experts), FP8 KV (fp8_ds_mla)vLLMWeights Repo Updated Oct 18, 2026

Details

2× DGX Spark

GLM-5.3-Flash 320B-A18B EXL3 4 bpw with ExLlamaV3 on 2× DGX Spark

by MiaAI-Lab

36.1tok/sEveryday

1 request, prose prompt, with DFlash2, TR3 weights (per recipe) Source

Intelligence42with thinking

≤ 3 bit: quantization may cost quality
Custom kernel required
Non-commercial
License unclear

EXL3 4bpw (TR3) + FP8 KV (fp8_ds_mla)TensorFold-basiertes Kit (ghcr.io/miaai-lab/glm-5.3-flash-2x-dgx-sparks:exl3-instanttensor), DFlash2 7 draft tokens; opt-in Speed-Boost-Profil (einmaliger ~25-min-Build auf dem Head)Weights Repo Updated Oct 18, 2026

Details

2× DGX Spark

MiMo-V2.6-Flash 309B MXFP4 with SGLang on 2× DGX Spark

by MiaAI-Lab

35tok/sEveryday

1 request, prose prompt, with EAGLE Source

Intelligenceno independent value

Experimental

FP8 attention + MXFP4 experts (Original)SGLangWeights Repo Updated Sep 25, 2026

Details

2× DGX Spark

DeepSeek-V4.1-Flash 763B EXL3 2.9 bpw with ExLlamaV3 on 2× DGX Spark

by MiaAI-Lab

31.6tok/sEveryday

1 request, prose prompt, with DSpark (per recipe) Source

Intelligence40with thinking no thinking 25

≤ 3 bit: quantization may cost quality
Experimental
Custom kernel required

EXL3 2.9 bpw + fp8_ds_mla KVvLLM + ExLlamaV3Weights Repo Updated Sep 25, 2026

Details

3× DGX Spark

GLM-5.3 753B EXL3 2.75 bpw with TensorFold on 3× DGX Spark

by MiaAI-Lab

31.3tok/sEveryday

1 request, prose prompt, with DSpark (per recipe) Source

Intelligence45with thinking

Custom kernel required
License unclear

EXL3 2,75 bpw Ø (Experten 2–4 bit), 4-bit dense, BF16 sonst, FP4 KV (Default CP=1)TensorFold v0.6.0 + 110 Patches, Image ghcr.io/miaai-lab/glm-5.3-exl3-3x-dgx-sparks-tensorfold:v0.6.0-4f3223245926, DSpark + Copy-Drafts, Context Parallelism, RoCEWeights Repo Updated Oct 4, 2026

Details

1× DGX Spark