Granite Speech 5.0 2B

IBM · 2.31B parameters · Speech to text

Weights and memory

16 options
FormatFile sizeYour deviceLink
Q2_K769 MBUnknownHugging Face
Q3_K_S874 MBUnknownHugging Face
Q3_K_M949 MBUnknownHugging Face
Q3_K_L1.0 GBUnknownHugging Face
Q4_01.1 GBUnknownHugging Face
Q4_K_S1.1 GBUnknownHugging Face
1.1 GBUnknownHugging Face
Q4_11.2 GBUnknownHugging Face
Q5_01.3 GBUnknownHugging Face
Q5_K_S1.3 GBUnknownHugging Face
Q5_K_M1.3 GBUnknownHugging Face
Q5_11.4 GBUnknownHugging Face
Q6_K1.5 GBUnknownHugging Face
2.0 GBUnknownHugging Face
3.7 GBUnknownHugging Face
—5.0 GBUnknownHugging Face

Published by the lab. File size is what the repository lists; for original weights it is the total of the weight files, which can include more than one variant. ● memory stated by the publisher · ◇ estimate from file size, an 8K-token context and 0.5 GB for the runtime. Unknown means there is no figure to go on. Checked 2026-11-02.

Tests on this site

Not tested yet

This site has not run this model. How tests are run