Modelpublic

bartowski/HuatuoGPT-o1-7B-GGUF

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face

5likes2.3kdownloads

fileHuatuoGPT-o1-7B-f16.gguf14.19 GBdownload

fileHuatuoGPT-o1-7B-IQ2_M.gguf2.59 GBdownload

fileHuatuoGPT-o1-7B-IQ3_M.gguf3.33 GBdownload

fileHuatuoGPT-o1-7B-IQ3_XS.gguf3.12 GBdownload

fileHuatuoGPT-o1-7B-IQ4_NL.gguf4.13 GBdownload

fileHuatuoGPT-o1-7B-IQ4_XS.gguf3.93 GBdownload

fileHuatuoGPT-o1-7B-Q2_K_L.gguf3.30 GBdownload

fileHuatuoGPT-o1-7B-Q2_K.gguf2.81 GBdownload

fileHuatuoGPT-o1-7B-Q3_K_L.gguf3.81 GBdownload

fileHuatuoGPT-o1-7B-Q3_K_M.gguf3.55 GBdownload

fileHuatuoGPT-o1-7B-Q3_K_S.gguf3.25 GBdownload

fileHuatuoGPT-o1-7B-Q3_K_XL.gguf4.25 GBdownload

fileHuatuoGPT-o1-7B-Q4_0.gguf4.14 GBdownload

fileHuatuoGPT-o1-7B-Q4_1.gguf4.54 GBdownload

fileHuatuoGPT-o1-7B-Q4_K_L.gguf4.74 GBdownload

fileHuatuoGPT-o1-7B-Q4_K_M.gguf4.36 GBdownload

fileHuatuoGPT-o1-7B-Q4_K_S.gguf4.15 GBdownload

fileHuatuoGPT-o1-7B-Q5_K_L.gguf5.38 GBdownload

fileHuatuoGPT-o1-7B-Q5_K_M.gguf5.07 GBdownload

fileHuatuoGPT-o1-7B-Q5_K_S.gguf4.95 GBdownload

fileHuatuoGPT-o1-7B-Q6_K_L.gguf6.07 GBdownload

fileHuatuoGPT-o1-7B-Q6_K.gguf5.82 GBdownload

fileHuatuoGPT-o1-7B-Q8_0.gguf7.54 GBdownload

bartowski/HuatuoGPT-o1-7B-GGUF · main · files are served by the source, never re-hosted here