---
type: "Article"
title: "Qwen3 BF16 with vLLM on 2× RTX 3090"
description: "Qwen3 BF16 with vLLM on 2× RTX 3090: recipe by alesha-pro with speed, condition and source for every number, weights and license."
resource: "https://www.contextstudios.ai/local-ai/alesha-pro--qwen3-cross-model-kv-prefill-reuse-2x3090"
language: "en"
generated:
  by: "process:contextstudios-md/1"
  at: "2026-11-11T03:30:19.016Z"
status: "stable"
---

# Qwen3 BF16 with vLLM on 2× RTX 3090

- Creator: [alesha-pro](https://www.contextstudios.ai/local-ai/creators/alesha-pro.md)
- Engine: vLLM 0.26.0
- Quantization: BF16 (Modelle), Ridge-Mapper fp32/bf16
- Model family: Qwen3
- Hardware: rtx-3090 x2
- Context: 32768

## All numbers

- no measured speed on record
- ttft_ms: 458 (1 request) — [source](https://github.com/alesha-pro/vllm-cross-model-kv#results)

## Weights

- [Qwen/Qwen3-0.6B](https://huggingface.co/Qwen/Qwen3-0.6B) (base, apache-2.0)
- [Qwen/Qwen3-1.7B](https://huggingface.co/Qwen/Qwen3-1.7B) (main, apache-2.0)

[https://github.com/alesha-pro/vllm-cross-model-kv](https://github.com/alesha-pro/vllm-cross-model-kv)

## Related

- [Local AI on your hardware.](https://www.contextstudios.ai/local-ai.md)