Hy MT2
Weights and memory
| Format | File size | Your device | Link | ||
|---|---|---|---|---|---|
| 1.8B | |||||
| 1.25-bit | 462 MB | 1.5 GB ◇ | Hugging Face | ||
| 2-bit | 601 MB | 1.6 GB ◇ | Hugging Face | ||
| 1.1 GB | 2.1 GB ◇ | Hugging Face | |||
| Q6_K | 1.5 GB | 2.4 GB ◇ | Hugging Face | ||
| 1.9 GB | 2.8 GB ◇ | Hugging Face | |||
| — | 4.1 GB | 4.8 GB ◇ | Hugging Face | ||
| 7B | |||||
| 4.6 GB | 5.9 GB ◇ | Hugging Face | |||
| Q6_K | 6.2 GB | 7.3 GB ◇ | Hugging Face | ||
| 8.0 GB | 9.0 GB ◇ | Hugging Face | |||
| — | 16.1 GB | 16.5 GB ◇ | Hugging Face | ||
| 30B-A3B | |||||
| 18.2 GB | 18.3 GB ◇ | Hugging Face | |||
| 32.0 GB | 31.1 GB ◇ | Hugging Face | |||
| — | 60.1 GB | 57.3 GB ◇ | Hugging Face | ||
Published by the lab. File size is what the repository lists; for original weights it is the total of the weight files, which can include more than one variant. ● memory stated by the publisher · ◇ estimate from file size, an 8K-token context and 0.5 GB for the runtime. Unknown means there is no figure to go on. Checked 2026-10-11.
Tests on this site
Not tested yetThis site has not run this model. What will be tested