Modelpublic

RichardErkhov/ConvexAI_-_Harmony-4x7B-bf16-gguf

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes398downloads

fileHarmony-4x7B-bf16.IQ3_M.gguf9.92 GBdownload

fileHarmony-4x7B-bf16.IQ3_S.gguf9.73 GBdownload

fileHarmony-4x7B-bf16.IQ3_XS.gguf9.21 GBdownload

fileHarmony-4x7B-bf16.IQ4_NL.gguf12.81 GBdownload

fileHarmony-4x7B-bf16.IQ4_XS.gguf12.15 GBdownload

fileHarmony-4x7B-bf16.Q2_K.gguf8.24 GBdownload

fileHarmony-4x7B-bf16.Q3_K_L.gguf11.68 GBdownload

fileHarmony-4x7B-bf16.Q3_K_M.gguf10.79 GBdownload

fileHarmony-4x7B-bf16.Q3_K_S.gguf9.72 GBdownload

fileHarmony-4x7B-bf16.Q3_K.gguf10.79 GBdownload

fileHarmony-4x7B-bf16.Q4_0.gguf12.69 GBdownload

fileHarmony-4x7B-bf16.Q4_1.gguf14.09 GBdownload

fileHarmony-4x7B-bf16.Q4_K_M.gguf13.61 GBdownload

fileHarmony-4x7B-bf16.Q4_K_S.gguf12.80 GBdownload

fileHarmony-4x7B-bf16.Q4_K.gguf13.61 GBdownload

fileHarmony-4x7B-bf16.Q5_0.gguf15.48 GBdownload

fileHarmony-4x7B-bf16.Q5_1.gguf16.88 GBdownload

fileHarmony-4x7B-bf16.Q5_K_M.gguf15.96 GBdownload

fileHarmony-4x7B-bf16.Q5_K_S.gguf15.48 GBdownload

fileHarmony-4x7B-bf16.Q5_K.gguf15.96 GBdownload

fileHarmony-4x7B-bf16.Q6_K.gguf18.46 GBdownload

fileHarmony-4x7B-bf16.Q8_0.gguf23.90 GBdownload

RichardErkhov/ConvexAI_-_Harmony-4x7B-bf16-gguf · main · files are served by the source, never re-hosted here