Kimi K3

Kimi

Moonshot AI Β· 2.8T (104B active) Β· Mixture of Experts

Frontier 2.8T multimodal MoE β€” 104B active, native video understanding, 1M context Check if your GPU or Mac can run Kimi K3 locally β€” 1553.4 GB min, 2589.1 GB recommended.

2026-071024K context

Mixture of Experts

Total experts: 896
Active experts: 16
Active params: 104.2B

Quantization Options

QuantBitsVRAMQualityStatus
Q2_K2890.5 GBlowβ€”
Q3_K_M31246.5 GBmoderateβ€”
Q4_K_M41424.5 GBgoodβ€”
Q5_K_M51780.5 GBgoodβ€”
Q6_K62136.5 GBexcellentβ€”
Q8_082848.5 GBexcellentβ€”
F16165696.5 GBlosslessβ€”

Can I run Kimi K3 locally?

Can I run Kimi K3 locally?
Kimi K3 needs about 1553.4 GB of memory at a minimum and 2589.1 GB recommended. Open this page to grade it against your GPU or Mac, then run it with runai, Ollama or LM Studio.
How much VRAM does Kimi K3 need?
At Q4_K_M, Kimi K3 uses about 1424.5 GB of VRAM. Higher quants need more memory; lower quants fit tighter cards with a quality tradeoff.