1× Mac
155tok/sEveryday
1 request, llmprobe standard prompt, thinking on, with MTP + PLD (per recipe) Source
Intelligence40with thinking
- Experimental
- License unclear
Local AI · Recipe · 1× Mac
Laya with arbiter on 1× Mac
by 0xBakeer
No speed value is documented for this recipe, so this page is not indexed.
Intelligence (original model) · Artificial Analysisno independent value
Engine
- Engine
- arbiter (torch MPS)
- Quantization
- fp32 (fp16/bf16 fallen durch Äquivalenz-Gate)
- Model family
- Laya (Convai Innovations, Klassifikator, kein LLM)
- Context
- —
- Creator
- 0xBakeer
- GitHub stars
- 29
- Repo updated
- Sep 25, 2026
Measurements
Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.
Time to first token
Shorter is better.
What you need
- Hardware
- 1 × Mac / Apple Silicon
- Weights
- Main weightsconvaiinnovations/laya Apache-2.0
- Engine
- arbiter (torch MPS)
Related recipes
1× Mac
53.3tok/sEveryday
1 request, prose prompt, with MTP (nativ) (per recipe) Source
Intelligenceno independent value
- License unclear
1× Mac
35.8tok/sEveryday
1 request, llmprobe standard prompt, thinking on, with embedded MTP (2 draft tokens) (per recipe) Source
Intelligence42with thinking
- Experimental
- No license on HF
- License unclear
1× Mac
28.5tok/sEveryday
1 request, prose prompt, context 32k, with DSpark (per recipe) Source
Intelligenceno independent value
- ≤ 3 bit: quantization may cost quality
1× Mac
25.1tok/sEveryday
1 request, prose prompt, short prompt, with MTP (DSpark built-in) (per recipe) Source
Intelligence40with thinkingno thinking 25
- ≤ 3 bit: quantization may cost quality
- No license on HF
- License unclear
1× MacBonsai-2-27B (Qwen3.8-27B-Basis)
10.6tok/sEveryday
1 request, prose prompt, no speculative decoding Source
Intelligenceno independent value
- Custom kernel required
Local AI in your company?
In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.