CoolFace
Modelpublic

mradermacher/LightGPT-7B-Llama2-GGUF

sourceHugging Facemitupdated 2y agoView on Hugging Face
0likes2.2kdownloads
fileLightGPT-7B-Llama2.f16.gguf12.55 GBdownload
fileLightGPT-7B-Llama2.IQ3_M.gguf2.90 GBdownload
fileLightGPT-7B-Llama2.IQ3_S.gguf2.75 GBdownload
fileLightGPT-7B-Llama2.IQ3_XS.gguf2.60 GBdownload
fileLightGPT-7B-Llama2.IQ4_XS.gguf3.40 GBdownload
fileLightGPT-7B-Llama2.Q2_K.gguf2.36 GBdownload
fileLightGPT-7B-Llama2.Q3_K_L.gguf3.35 GBdownload
fileLightGPT-7B-Llama2.Q3_K_M.gguf3.07 GBdownload
fileLightGPT-7B-Llama2.Q3_K_S.gguf2.75 GBdownload
fileLightGPT-7B-Llama2.Q4_K_M.gguf3.80 GBdownload
fileLightGPT-7B-Llama2.Q4_K_S.gguf3.59 GBdownload
fileLightGPT-7B-Llama2.Q5_K_M.gguf4.45 GBdownload
fileLightGPT-7B-Llama2.Q5_K_S.gguf4.33 GBdownload
fileLightGPT-7B-Llama2.Q6_K.gguf5.15 GBdownload
fileLightGPT-7B-Llama2.Q8_0.gguf6.67 GBdownload

mradermacher/LightGPT-7B-Llama2-GGUF · main · files are served by the source, never re-hosted here