GLM 4 32B 0414
32.6B parameters · 32k context · MIT · released 2025-04-07
chatcodingagentic
What to run it on in Canada
Fully in memory at 8k context, priced at retailers today.
Nothing we price holds this model fully in memory.
All hardware that runs it
Everything we price, best value first. Two cards split the model by layers.
Nothing we price can run it at this context.
Memory needed
Weights, KV cache and runtime buffers at each context length (KV cache at fp16).
| Quant | File |
|---|
Run it
Copy a command for the runtime you use.
No published builds to run yet.
Notes
Tool calling in JSON format is supported via HuggingFace Transformers, vLLM, or sgLang. The card only mentions a 32K context limit in an eval footnote where YaRN extension was not used, so check config.json for the real context length.
Questions
- What licence is GLM 4 32B 0414 released under?
- MIT, which allows commercial use.