Local AI · Recipe · 1× Mac

DeepSeek-V4.1-Flash 763B with MLX on 1× Mac

DeepSeek-V4.1-Flash 763B with MLX on 1× Mac: 25.1 tok/s according to github.com (dataset as of Nov 3, 2026).

by drowzeys

25.1tok/sEveryday

1 request, prose prompt, short prompt, with MTP (DSpark built-in) (per recipe)

Source: github.com
Intelligence (original model) · Artificial Analysis40with thinkingno thinking 25

≤ 3 bit: quantization may cost quality

Engine

Engine
oMLX 0.7.0.dev2 @395ec2fd, MLX 0.32.2
Quantization
oQ3e (affine 3-bit) mit 27/40 MoE-Layern 2-bit gs64
Model family
DeepSeek-V4.1-Flash
Context
404,805
Parameters
763B MoE
Creator
drowzeys
GitHub stars
6
Repo updated
Sep 16, 2026

Measurements

Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.

Decode · 1 request

  • Everyday (decode)25.1 tok/scontext kurz · Prose, TTFT 0.78 s Source 
  • Peak (decode)29.9 tok/scontext kurz · Code Source 

Prefill by context

Time to first token

Shorter is better.

What you need

Hardware
1 × Mac / Apple Silicon
Engine
oMLX 0.7.0.dev2 @395ec2fd, MLX 0.32.2
Context
404,805 tokens

Notes

What matters before you rebuild it.

  • ≤ 3 bit: quantization may cost qualityAt 3 bit and below the model may answer noticeably worse than the original. The intelligence number refers to the original.
  • No license on HF
  • License unclear

Sources

Related recipes

8× DGX Spark
74tok/sEveryday

1 request, generation at 32K context (speed table, ring of eight), thinking on, high, with DSpark (per recipe); experimental profile Source 

  • Custom kernel required
  • Experimental

Stock-Checkpoint FP8/MXFP4 (DeepSeek)vLLM (local-inference-lab Fork) via SparkRing (SIRCL-Collectives, switchless RDMA ueber ConnectX-7), Image Release 2026.10.2Weights Repo Updated Nov 2, 2026

Details

← Back to overview

Local AI in your company?

In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.