Modelpublic

QuantFactory/selfrag_llama2_7b-GGUF

sourceHugging Facemitupdated 2y agoView on Hugging Face

2likes170downloads

fileselfrag_llama2_7b.Q2_K.gguf2.36 GBdownload

fileselfrag_llama2_7b.Q3_K_L.gguf3.35 GBdownload

fileselfrag_llama2_7b.Q3_K_M.gguf3.07 GBdownload

fileselfrag_llama2_7b.Q3_K_S.gguf2.75 GBdownload

fileselfrag_llama2_7b.Q4_0_4_4.gguf3.56 GBdownload

fileselfrag_llama2_7b.Q4_0_4_8.gguf3.56 GBdownload

fileselfrag_llama2_7b.Q4_0_8_8.gguf3.56 GBdownload

fileselfrag_llama2_7b.Q4_0.gguf3.56 GBdownload

fileselfrag_llama2_7b.Q4_1.gguf3.95 GBdownload

fileselfrag_llama2_7b.Q4_K_M.gguf3.80 GBdownload

fileselfrag_llama2_7b.Q4_K_S.gguf3.59 GBdownload

fileselfrag_llama2_7b.Q5_0.gguf4.33 GBdownload

fileselfrag_llama2_7b.Q5_1.gguf4.72 GBdownload

fileselfrag_llama2_7b.Q5_K_M.gguf4.45 GBdownload

fileselfrag_llama2_7b.Q5_K_S.gguf4.33 GBdownload

fileselfrag_llama2_7b.Q6_K.gguf5.15 GBdownload

fileselfrag_llama2_7b.Q8_0.gguf6.67 GBdownload

QuantFactory/selfrag_llama2_7b-GGUF · main · files are served by the source, never re-hosted here