GLM 4.1V 9B Thinking

• Cheapest

  AMD Radeon RX 7900 XT

  26tok/sest.mlx-8bit

  855 €

• Best value

  AMD Radeon RX 7900 XT

  26tok/sest.mlx-8bit

  855 €

• Fastest

  NVIDIA GeForce RTX 5090

  65tok/sest.mlx-8bit

  6.028 €

• Mac

  Mac Studio M4 Max 64GB

  21tok/sest.mlx-8bit

  4.183 €

1 other card or machine we price cannot hold it at this context.

• mlx-8bit
  • LM Studiolms get mlx-community/GLM-4.1V-9B-Thinking-8bit
  • MLXmlx_lm.server --model mlx-community/GLM-4.1V-9B-Thinking-8bit

Needs transformers 4.57.1 or later. It is a 9B bilingual (Chinese/English) vision-language reasoning model that handles images up to 4K resolution at any aspect ratio.

What is the best GPU for running GLM 4.1V 9B Thinking locally?

The cheapest hardware in Germany that runs GLM 4.1V 9B Thinking fully in memory at 128k context is the AMD Radeon RX 7900 XT, 855 € at Amazon, at about 26 tok/s (estimated). The fastest we price is the NVIDIA GeForce RTX 5090, at about 65 tok/s.

Can I run GLM 4.1V 9B Thinking on a 16 GB GPU?

Only partly: at 128k context it does not fit in 16 GB, so part of it runs from system RAM and it slows to about 8 tok/s on the AMD Radeon RX 9060 XT 16GB (estimated).

Can I run GLM 4.1V 9B Thinking on a 24 GB GPU?

Yes: at mlx-8bit it fits fully in 24 GB at 128k context. On the NVIDIA GeForce RTX 3090 Ti it runs at about 37 tok/s (estimated).

What licence is GLM 4.1V 9B Thinking released under?

MIT, which allows commercial use.