A newer version is available: Qwen 3.5 0.8BView β†’

Qwen 3 0.6B

Apache 2.0

Alibaba Β· 0.6B Β· Dense

Ultra-light Qwen 3 model for constrained devices Check if your GPU or Mac can run Qwen 3 0.6B locally β€” 1 GB min, 2 GB recommended.

2025-0432K context

Quantization Options

QuantBitsVRAMQualityStatus
Q4_K_M40.8 GBgoodβ€”
Q6_K61 GBexcellentβ€”
Q8_081.1 GBexcellentβ€”

Can I run Qwen 3 0.6B locally?

Can I run Qwen 3 0.6B locally?
Qwen 3 0.6B needs about 1 GB of memory at a minimum and 2 GB recommended. Open this page to grade it against your GPU or Mac, then run it with runai, Ollama or LM Studio.
How much VRAM does Qwen 3 0.6B need?
At Q4_K_M, Qwen 3 0.6B uses about 0.8 GB of VRAM. Higher quants need more memory; lower quants fit tighter cards with a quality tradeoff.