Modelpublic

mradermacher/bloom-zh-3b-chat-GGUF

sourceHugging Facebigscience-openrail-mupdated 2y agoView on Hugging Face

2likes719downloads

filebloom-zh-3b-chat.f16.gguf6.80 GBdownload

filebloom-zh-3b-chat.IQ4_XS.gguf2.00 GBdownload

filebloom-zh-3b-chat.Q2_K.gguf1.52 GBdownload

filebloom-zh-3b-chat.Q3_K_L.gguf2.02 GBdownload

filebloom-zh-3b-chat.Q3_K_M.gguf1.90 GBdownload

filebloom-zh-3b-chat.Q3_K_S.gguf1.71 GBdownload

filebloom-zh-3b-chat.Q4_0_4_4.gguf2.08 GBdownload

filebloom-zh-3b-chat.Q4_K_M.gguf2.23 GBdownload

filebloom-zh-3b-chat.Q4_K_S.gguf2.09 GBdownload

filebloom-zh-3b-chat.Q5_K_M.gguf2.55 GBdownload

filebloom-zh-3b-chat.Q5_K_S.gguf2.43 GBdownload

filebloom-zh-3b-chat.Q6_K.gguf2.80 GBdownload

filebloom-zh-3b-chat.Q8_0.gguf3.62 GBdownload

mradermacher/bloom-zh-3b-chat-GGUF · main · files are served by the source, never re-hosted here