Modelpublic

mradermacher/granite-guardian-3.3-8b-GGUF

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face

0likes467downloads

filegranite-guardian-3.3-8b.f16.gguf15.22 GBdownload

filegranite-guardian-3.3-8b.IQ4_XS.gguf4.16 GBdownload

filegranite-guardian-3.3-8b.Q2_K.gguf2.89 GBdownload

filegranite-guardian-3.3-8b.Q3_K_L.gguf4.05 GBdownload

filegranite-guardian-3.3-8b.Q3_K_M.gguf3.72 GBdownload

filegranite-guardian-3.3-8b.Q3_K_S.gguf3.35 GBdownload

filegranite-guardian-3.3-8b.Q4_K_M.gguf4.60 GBdownload

filegranite-guardian-3.3-8b.Q4_K_S.gguf4.36 GBdownload

filegranite-guardian-3.3-8b.Q5_K_M.gguf5.40 GBdownload

filegranite-guardian-3.3-8b.Q5_K_S.gguf5.26 GBdownload

filegranite-guardian-3.3-8b.Q6_K.gguf6.24 GBdownload

filegranite-guardian-3.3-8b.Q8_0.gguf8.09 GBdownload

mradermacher/granite-guardian-3.3-8b-GGUF · main · files are served by the source, never re-hosted here