Ternary Bonsai 2: 27B under 6 GB — the first browser model for the 16-GB everyday
(01)Ternary Bonsai 2 compresses Qwen3.8-27B to 5.95 GB — 98.2% of the quality. What that means for 16 GB and 8 GB setups, with our own cluster measurement.
Your goal
Be visible where AI answers
Automate processes
Build a product
Put AI agents to work
Connect and modernize systems
Know where we stand
Use Cases
CRMStrengthen customer relationshipsPopularE-CommerceBoost online revenueBooking System24/7 appointment bookingProject ManagementCoordinate teamsInvoicingGet paid fasterAnalyticsData-driven decisionsKnowledge Hub
All articles about Quantization
Ternary Bonsai 2 compresses Qwen3.8-27B to 5.95 GB — 98.2% of the quality. What that means for 16 GB and 8 GB setups, with our own cluster measurement.
IST-DASLab ships Qwen3.8-27B as GGUF in four sizes — 8.4 to 11.8 GB. IQ3_S keeps 99.8 % of base performance at a 4.6× reduction and fits on 16-GB cards. With the file table, measured token rates, and a decision rule.
From 8 GB to 512 GB VRAM: which local AI models run on your hardware — with the production recipes and benchmarks from Mia's AI Lab.
DeepSeek-V4-Flash activates 13B parameters per token but keeps 284B resident. Its experts ship in FP4, and that one choice sets almost the whole memory bill.