Local AI · Recipe · 1× DGX Spark

Ornith-1.5 35B NVFP4 with SGLang on 1× DGX Spark

Ornith-1.5 35B NVFP4 with SGLang on 1× DGX Spark: 74.9 tok/s according to github.com (dataset as of Nov 3, 2026).

by vcruz305

74.9tok/sPeak

1 request, best value reported by source

Source: github.com
Intelligence (original model) · Artificial Analysisno independent value

Engine

Engine
SGLang / vLLM SGLang 0.5.18.dev760 / vLLM g75231eff2
Quantization
NVFP4 (ModelOpt, 21.4 GB)
Model family
Ornith-1.5
Context
262,144
Parameters
~35B MoE / ~3B active
Creator
vcruz305
GitHub stars
3
Repo updated
Aug 27, 2026

Measurements

Every sourced value of this recipe, each with its condition and source. Bars relative to the largest value in the group.

Decode · 1 request

Prefill by context

What you need

Hardware
1 × NVIDIA DGX Spark (GB10)
Engine
SGLang / vLLM SGLang 0.5.18.dev760 / vLLM g75231eff2
Context
262,144 tokens

Related recipes

1× DGX Spark
71.8tok/sEveryday

1 request, prose prompt (sampled, thinking off), with LiLiCorr (per recipe) Source 

Intelligenceno independent value
  • ≤ 3 bit: quantization may cost quality
  • Custom kernel required
  • License unclear

24GB pack: IQ2_XXS experts (2.0625 bits), NVFP4 Mamba projections, Q8_0 attention/latent projections/lm_head; bf16 KVTensorFold tensorfold-native v1.1.6 (eea9dc9c) + recipe patches/ (Bolt lane backend, libbolt.so CUDA forward pass), LiLiCorr draftsWeights Repo Updated Nov 1, 2026

Details
1× DGX Spark
59.4tok/sEveryday

1 request, chat prompt (20 prompts, thinking off), no drafting (default profile) Source 

Intelligenceno independent value
  • Custom kernel required

EXL3 6.08 bpw (28,3 GB), FP16 KV; nur Textpfad (Vision-Tower wird von ExLlamaV3 nicht ausgeführt)ExLlamaV3 1.5.0 (Fork r0b0tlab/exllamav3-r0b0t, Branch minicpm-v4.7-dspark @ 5ddae7d12448), torch 2.14.0+cu130Weights Repo Updated Oct 14, 2026

Details

← Back to overview

Local AI in your company?

In a workshop we work out which models and which hardware fit your tasks, and build the first agent on your infrastructure.