1 request, decode at 16K context (record 2026-10-04), thinking on Source
- Custom kernel required
Il Suo obiettivo
Essere visibili dove risponde l'IA
Automatizzare i processi
Costruire un prodotto
Mettere al lavoro gli agenti IA
Collegare e modernizzare i sistemi
Sapere a che punto siamo
Casi d'Uso
CRMRafforzare relazioni clientiPopolareE-CommerceAumentare vendite onlineSistema prenotazioniPrenotazioni 24/7Gestione progettiCoordinare i teamFatturazionePagamenti più velociAnalyticsDecisioni basate sui datiLocal AI · Recipe · 2× DGX Spark
MiMo-V2.6-Flash-MOPD 309B-A15B with vLLM on 2× DGX Spark: 49 tok/s according to github.com (dataset as of Nov 3, 2026).
by myllmbox
1 request, code-heavy spec prompt (SQL/TypeScript), thinking off, with MTP K=3
Source: github.comEvery sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.
Shorter is better.
What matters before you rebuild it.
1 request, decode at 16K context (record 2026-10-04), thinking on Source
1 request, decode at 16K context (record 2026-10-04), thinking on Source
1 request, prose prompt, with MTP (per recipe) Source
1 request, prose prompt (long story), thinking off, with MTP Source
1 request, prose prompt, with MTP (per recipe) Source
1 request, generation at 32K context (speed table, pair), thinking on, xhigh, with MTP3 (per recipe) Source
In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.