Kimi VL A3B Thinking
16.4B total, 3B active · 128k context · MIT · released 2025-04-09
visionreasoningchatagentic
What to run it on in the US
Fully in memory at 32k context, priced at retailers today.
Nothing we price holds this model fully in memory.
All hardware that runs it
Everything we price, best value first. Two cards split the model by layers.
Nothing we price can run it at this context.
Memory needed
Weights, KV cache and runtime buffers at each context length (KV cache at fp16).
| Quant | File |
|---|
Run it
Copy a command for the runtime you use.
No published builds to run yet.
Notes
A newer version (Kimi-VL-A3B-Thinking-2506) has replaced this one; the card recommends transformers 4.48.2 with trust_remote_code and Temperature 0.8. At the time the card was written, vLLM support was only available from the branch of an unmerged pull request (#16387).
Questions
- What licence is Kimi VL A3B Thinking released under?
- MIT, which allows commercial use.