Local AI Picksdata checked 2026-10-11

Index Translate

Bilibili IndexTeam · 2.27B parameters · Translation

View weights on Hugging Face

Weights and memory

39 options
FormatFile sizeYour device
2B
Q2_K990 MB1.8 GB ◇Hugging Face
Q3_K_S1.0 GB1.9 GB ◇Hugging Face
Q3_K_M1.1 GB2.0 GB ◇Hugging Face
Q3_K_L1.2 GB2.0 GB ◇Hugging Face
IQ4_XS1.2 GB2.1 GB ◇Hugging Face
Q4_K_S1.2 GB2.1 GB ◇Hugging Face
1.3 GB2.1 GB ◇Hugging Face
Q5_K_S1.4 GB2.2 GB ◇Hugging Face
Q5_K_M1.5 GB2.3 GB ◇Hugging Face
Q6_K1.6 GB2.4 GB ◇Hugging Face
2.1 GB2.9 GB ◇Hugging Face
F163.9 GB4.6 GB ◇Hugging Face
—4.5 GB5.2 GB ◇Hugging Face
9B
Q2_K3.9 GB5.2 GB ◇Hugging Face
Q3_K_S4.4 GB5.6 GB ◇Hugging Face
Q3_K_M4.7 GB6.0 GB ◇Hugging Face
Q3_K_L5.0 GB6.3 GB ◇Hugging Face
IQ4_XS5.4 GB6.5 GB ◇Hugging Face
Q4_K_S5.5 GB6.7 GB ◇Hugging Face
5.8 GB6.9 GB ◇Hugging Face
Q5_K_S6.5 GB7.6 GB ◇Hugging Face
Q5_K_M6.6 GB7.7 GB ◇Hugging Face
Q6_K7.6 GB8.6 GB ◇Hugging Face
9.8 GB10.7 GB ◇Hugging Face
F1618.4 GB18.7 GB ◇Hugging Face
—19.3 GB19.5 GB ◇Hugging Face
35B-A3B
Q2_K13.2 GB13.5 GB ◇Hugging Face
Q3_K_S15.5 GB15.7 GB ◇Hugging Face
Q3_K_M17.2 GB17.2 GB ◇Hugging Face
Q3_K_L18.6 GB18.5 GB ◇Hugging Face
IQ4_XS19.4 GB19.2 GB ◇Hugging Face
Q4_K_S20.4 GB20.1 GB ◇Hugging Face
21.7 GB21.4 GB ◇Hugging Face
Q5_K_S24.6 GB24.1 GB ◇Hugging Face
Q5_K_M25.3 GB24.8 GB ◇Hugging Face
Q6_K29.2 GB28.4 GB ◇Hugging Face
37.8 GB36.4 GB ◇Hugging Face
F1671.1 GB67.4 GB ◇Hugging Face
—71.9 GB68.1 GB ◇Hugging Face

Published by the lab. File size is what the repository lists; for original weights it is the total of the weight files, which can include more than one variant. ● memory stated by the publisher · ◇ estimate from file size, an 8K-token context and 0.5 GB for the runtime. Unknown means there is no figure to go on. Checked 2026-10-11.

Tests on this site

Not tested yet

This site has not run this model. What will be tested