Granite 4.2
Weights and memory
| Format | File size | Your device | Link | ||
|---|---|---|---|---|---|
| 3B | |||||
| Q2_K | 1.5 GB | 2.5 GB ◇ | Hugging Face | ||
| Q3_K_S | 1.7 GB | 2.7 GB ◇ | Hugging Face | ||
| Q3_K_M | 1.8 GB | 2.9 GB ◇ | Hugging Face | ||
| Q3_K_L | 2.0 GB | 3.0 GB ◇ | Hugging Face | ||
| Q4_0 | 2.1 GB | 3.2 GB ◇ | Hugging Face | ||
| Q4_K_S | 2.1 GB | 3.2 GB ◇ | Hugging Face | ||
| 2.2 GB | 3.3 GB ◇ | Hugging Face | |||
| Q4_1 | 2.3 GB | 3.4 GB ◇ | Hugging Face | ||
| Q5_0 | 2.6 GB | 3.6 GB ◇ | Hugging Face | ||
| Q5_K_S | 2.6 GB | 3.6 GB ◇ | Hugging Face | ||
| Q5_K_M | 2.6 GB | 3.6 GB ◇ | Hugging Face | ||
| Q5_1 | 2.8 GB | 3.8 GB ◇ | Hugging Face | ||
| Q6_K | 3.0 GB | 4.0 GB ◇ | Hugging Face | ||
| 3.9 GB | 4.8 GB ◇ | Hugging Face | |||
| 7.3 GB | 8.0 GB ◇ | Hugging Face | |||
| 4-bit | 2.1 GB | 3.1 GB ◇ | Hugging Face | ||
| 8-bit | 3.9 GB | 4.8 GB ◇ | Hugging Face | ||
| 7.3 GB | 8.0 GB ◇ | Hugging Face | |||
| — | 7.3 GB | 8.0 GB ◇ | Hugging Face | ||
| 8B | |||||
| Q2_K | 3.4 GB | 5.0 GB ◇ | Hugging Face | ||
| Q3_K_S | 3.9 GB | 5.5 GB ◇ | Hugging Face | ||
| Q3_K_M | 4.3 GB | 5.8 GB ◇ | Hugging Face | ||
| Q3_K_L | 4.7 GB | 6.2 GB ◇ | Hugging Face | ||
| Q4_0 | 5.1 GB | 6.5 GB ◇ | Hugging Face | ||
| Q4_K_S | 5.1 GB | 6.5 GB ◇ | Hugging Face | ||
| 5.3 GB | 6.8 GB ◇ | Hugging Face | |||
| Q4_1 | 5.6 GB | 7.0 GB ◇ | Hugging Face | ||
| Q5_0 | 6.1 GB | 7.5 GB ◇ | Hugging Face | ||
| Q5_K_S | 6.1 GB | 7.5 GB ◇ | Hugging Face | ||
| Q5_K_M | 6.3 GB | 7.6 GB ◇ | Hugging Face | ||
| Q5_1 | 6.6 GB | 8.0 GB ◇ | Hugging Face | ||
| Q6_K | 7.2 GB | 8.5 GB ◇ | Hugging Face | ||
| 9.3 GB | 10.5 GB ◇ | Hugging Face | |||
| 17.6 GB | 18.2 GB ◇ | Hugging Face | |||
| 4-bit | 4.9 GB | 6.4 GB ◇ | Hugging Face | ||
| 8-bit | 9.3 GB | 10.5 GB ◇ | Hugging Face | ||
| 17.6 GB | 18.2 GB ◇ | Hugging Face | |||
| — | 17.6 GB | 18.2 GB ◇ | Hugging Face | ||
| 30B | |||||
| Q2_K | 10.9 GB | 12.7 GB ◇ | Hugging Face | ||
| Q3_K_S | 12.7 GB | 14.4 GB ◇ | Hugging Face | ||
| Q3_K_M | 14.1 GB | 15.7 GB ◇ | Hugging Face | ||
| Q3_K_L | 15.3 GB | 16.8 GB ◇ | Hugging Face | ||
| Q4_0 | 16.6 GB | 18.0 GB ◇ | Hugging Face | ||
| Q4_K_S | 16.7 GB | 18.1 GB ◇ | Hugging Face | ||
| 17.7 GB | 19.1 GB ◇ | Hugging Face | |||
| Q4_1 | 18.4 GB | 19.7 GB ◇ | Hugging Face | ||
| Q5_0 | 20.2 GB | 21.4 GB ◇ | Hugging Face | ||
| Q5_K_S | 20.2 GB | 21.4 GB ◇ | Hugging Face | ||
| Q5_K_M | 20.8 GB | 21.9 GB ◇ | Hugging Face | ||
| Q5_1 | 22.0 GB | 23.0 GB ◇ | Hugging Face | ||
| Q6_K | 24.0 GB | 24.9 GB ◇ | Hugging Face | ||
| 31.1 GB | 31.5 GB ◇ | Hugging Face | |||
| 58.6 GB | 57.1 GB ◇ | Hugging Face | |||
| 4-bit | 16.5 GB | 17.9 GB ◇ | Hugging Face | ||
| 8-bit | 31.1 GB | 31.5 GB ◇ | Hugging Face | ||
| 58.6 GB | 57.1 GB ◇ | Hugging Face | |||
| — | 58.6 GB | 57.1 GB ◇ | Hugging Face | ||
Published by the lab. File size is what the repository lists; for original weights it is the total of the weight files, which can include more than one variant. ● memory stated by the publisher · ◇ estimate from file size, an 8K-token context and 0.5 GB for the runtime. Unknown means there is no figure to go on. Checked 2026-10-11.
Tests on this site
Not tested yetThis site has not run this model. What will be tested