FrogNano 4B 2609

• Cheapest

  NVIDIA GeForce RTX 3060 12GB

  25tok/sest.Q8_0

  309 €

• Best value

  NVIDIA GeForce RTX 3080 10GB

  58tok/sest.Q6_K

  555 €

• Fastest

  NVIDIA GeForce RTX 5090

  124tok/sest.Q8_0

  6.042 €

• Mac

  Mac mini M4 Pro 48GB

  20tok/sest.Q8_0

  2.699 €

• Q4_K_M
  • Ollamaollama run hf.co/bartowski/FrogNano-4B-2609-GGUF:Q4_K_M
  • LM Studiolms get bartowski/FrogNano-4B-2609-GGUF@q4_k_m
  • llama.cppllama-server -hf bartowski/FrogNano-4B-2609-GGUF:Q4_K_M
• Q5_K_M
  • Ollamaollama run hf.co/bartowski/FrogNano-4B-2609-GGUF:Q5_K_M
  • LM Studiolms get bartowski/FrogNano-4B-2609-GGUF@q5_k_m
  • llama.cppllama-server -hf bartowski/FrogNano-4B-2609-GGUF:Q5_K_M
• Q6_K
  • Ollamaollama run hf.co/bartowski/FrogNano-4B-2609-GGUF:Q6_K
  • LM Studiolms get bartowski/FrogNano-4B-2609-GGUF@q6_k
  • llama.cppllama-server -hf bartowski/FrogNano-4B-2609-GGUF:Q6_K
• Q8_0
  • Ollamaollama run hf.co/bartowski/FrogNano-4B-2609-GGUF:Q8_0
  • LM Studiolms get bartowski/FrogNano-4B-2609-GGUF@q8_0
  • llama.cppllama-server -hf bartowski/FrogNano-4B-2609-GGUF:Q8_0

Card metadata says license: mit but the body states Apache License 2.0; verify before commercial use. Specialized for Python-heavy repo tasks with the Leaf harness; needs a Qwen3.5-capable runtime (SGLang used), and image/video are unsupported.

How much VRAM does FrogNano 4B 2609 need?

At Q4_K_M, FrogNano 4B 2609 needs about 4 GB of memory at 8k context and 8 GB at 128k, counting the weights, the KV cache and runtime buffers.

What is the best GPU for running FrogNano 4B 2609 locally?

The cheapest hardware in Germany that runs FrogNano 4B 2609 fully in memory at 128k context is the NVIDIA GeForce RTX 3060 12GB, 309 € at Amazon, at about 25 tok/s (estimated). The best value is the NVIDIA GeForce RTX 3080 10GB (about 58 tok/s for 555 €). The fastest we price is the NVIDIA GeForce RTX 5090, at about 124 tok/s.

Can I run FrogNano 4B 2609 on a 16 GB GPU?

Yes: at Q8_0 it fits fully in 16 GB at 128k context. On the NVIDIA GeForce RTX 5080 it runs at about 66 tok/s (estimated).

Can I run FrogNano 4B 2609 on a 24 GB GPU?

Yes: at Q8_0 it fits fully in 24 GB at 128k context. On the NVIDIA GeForce RTX 3090 Ti it runs at about 70 tok/s (estimated).

How do I run FrogNano 4B 2609 locally?

With Ollama: ollama run hf.co/bartowski/FrogNano-4B-2609-GGUF:Q4_K_M (the Q4_K_M build). LM Studio and llama.cpp commands are on this page.

What licence is FrogNano 4B 2609 released under?

Apache License 2.0, which allows commercial use.