Local AI Picksdata checked 2026-10-11

Granite Guardian 4.1

IBM · 8.38B parameters · Safety filters

View weights on Hugging Face

Weights and memory

16 options
FormatFile sizeYour device
Q2_K3.3 GBUnknownHugging Face
Q3_K_S3.8 GBUnknownHugging Face
Q3_K_M4.2 GBUnknownHugging Face
Q3_K_L4.5 GBUnknownHugging Face
Q4_04.8 GBUnknownHugging Face
Q4_K_S4.9 GBUnknownHugging Face
5.1 GBUnknownHugging Face
Q4_15.3 GBUnknownHugging Face
Q5_05.8 GBUnknownHugging Face
Q5_K_S5.8 GBUnknownHugging Face
Q5_K_M6.0 GBUnknownHugging Face
Q5_16.3 GBUnknownHugging Face
Q6_K6.9 GBUnknownHugging Face
8.9 GBUnknownHugging Face
16.8 GBUnknownHugging Face
—16.8 GBUnknownHugging Face

Published by the lab. File size is what the repository lists; for original weights it is the total of the weight files, which can include more than one variant. ● memory stated by the publisher · ◇ estimate from file size, an 8K-token context and 0.5 GB for the runtime. Unknown means there is no figure to go on. Checked 2026-10-11.

Tests on this site

Not in the first test round

Code, agent, embedding and safety models are listed with their sources only. What will be tested