---
type: "Article"
title: "MiniCPM-V 4.7 35B-A3B EXL3 3.74 bpw mit ExLlamaV3 auf 1× DGX Spark"
description: "MiniCPM-V 4.7 35B-A3B EXL3 3.74 bpw mit ExLlamaV3 auf 1× DGX Spark: Rezept von vcruz305 mit Tempo, Bedingung und Quelle je Zahl, Gewichten und Lizenz."
resource: "https://www.contextstudios.ai/de/lokale-ki/vcruz305--minicpm-v4.7-35b-exl3-sage-3.74-1spark-tabby"
language: "de"
generated:
  by: "process:contextstudios-md/1"
  at: "2026-11-11T03:38:03.242Z"
status: "stable"
---

# MiniCPM-V 4.7 35B-A3B EXL3 3.74 bpw mit ExLlamaV3 auf 1× DGX Spark

MiniCPM-V 4.7 35B-A3B EXL3 3.74 bpw mit ExLlamaV3 auf 1× DGX Spark: 60,3 tok/s laut github.com (Datensatz-Stand: 3. Nov. 2026).

- Kreator: [vcruz305](https://www.contextstudios.ai/de/lokale-ki/kreatoren/vcruz305.md)
- Engine: ExLlamaV3 Fork vcruz305 (master, gemessen dc778646 / 475461e9) + TabbyAPI Fork vcruz305
- Quantisierung: EXL3 SAGE 3.74bpw (Kopf/Vision 8-bit), FP16-KV (8K) bzw. Q4-KV (262K)
- Modellfamilie: MiniCPM-V-4.7-35B-A3B
- Hardware: dgx-spark x1
- Kontext: 262144

## Alle Zahlen

- 60,3 tok/s (Alltag; Alltag, 1 Anfrage, Prosa-Prompt (Essay), Kontext 2k, ohne Drafter (laut Rezept)) — [source](https://github.com/vcruz305/MiniCPM-V-4.7-35B-A3B-EXL3-DGX-Spark-recipe#dspark-exact-speculative-decoding)
- decode_tps: 60.3 (1 Anfrage) — [source](https://github.com/vcruz305/MiniCPM-V-4.7-35B-A3B-EXL3-DGX-Spark-recipe#dspark-exact-speculative-decoding)
- decode_tps: 69.48 (1 Anfrage) — [source](https://github.com/vcruz305/MiniCPM-V-4.7-35B-A3B-EXL3-DGX-Spark-recipe#dspark-exact-speculative-decoding)
- prefill_tps: 1056 (1 Anfrage) — [source](https://github.com/vcruz305/MiniCPM-V-4.7-35B-A3B-EXL3-DGX-Spark-recipe#full-context-results-one-dgx-spark)
- ttft_ms: 948 (1 Anfrage) — [source](https://github.com/vcruz305/MiniCPM-V-4.7-35B-A3B-EXL3-DGX-Spark-recipe#dspark-exact-speculative-decoding)

## Gewichte

- [vcruz305/MiniCPM-V-4.7-35B-A3B-EXL3-SAGE-3.74bpw](https://huggingface.co/vcruz305/MiniCPM-V-4.7-35B-A3B-EXL3-SAGE-3.74bpw) (main, apache-2.0)
- [openbmb/MiniCPM-V-4.7-35B-A3B](https://huggingface.co/openbmb/MiniCPM-V-4.7-35B-A3B) (base, apache-2.0)

[https://github.com/vcruz305/MiniCPM-V-4.7-35B-A3B-EXL3-DGX-Spark-recipe](https://github.com/vcruz305/MiniCPM-V-4.7-35B-A3B-EXL3-DGX-Spark-recipe)

## Related

- [Lokale KI auf Ihrer Hardware.](https://www.contextstudios.ai/de/lokale-ki.md)