MiniCPM-V 4.7 35B-A3B

OpenBMB · 35.2B parameters · Language models

Weights and memory

18 options
FormatFile sizeYour deviceLink
F16789 MB1.9 GB ◇Hugging Face
IQ3_XS14.5 GB14.7 GB ◇Hugging Face
IQ3_M15.4 GB15.6 GB ◇Hugging Face
—15.5 GB15.6 GB ◇Hugging Face
IQ4_XS18.7 GB18.6 GB ◇Hugging Face
Q4_019.7 GB19.5 GB ◇Hugging Face
IQ4_NL19.8 GB19.6 GB ◇Hugging Face
Q4_K_S19.9 GB19.7 GB ◇Hugging Face
21.2 GB20.9 GB ◇Hugging Face
Q4_121.8 GB21.5 GB ◇Hugging Face
Q5_024.0 GB23.5 GB ◇Hugging Face
Q5_K_S24.0 GB23.5 GB ◇Hugging Face
Q5_K_M24.7 GB24.2 GB ◇Hugging Face
Q5_126.1 GB25.5 GB ◇Hugging Face
Q6_K28.5 GB27.7 GB ◇Hugging Face
36.9 GB35.5 GB ◇Hugging Face
F1669.4 GB65.8 GB ◇Hugging Face
—70.4 GB66.8 GB ◇Hugging Face

Published by the lab. File size is what the repository lists; for original weights it is the total of the weight files, which can include more than one variant. ● memory stated by the publisher · ◇ estimate from file size, an 8K-token context and 0.5 GB for the runtime. Unknown means there is no figure to go on. Checked 2026-10-23.

Tests on this site

Not tested yet

This site has not run this model. How tests are run