Modelpublic

lmstudio-community/Llama3-ChatQA-1.5-70B-GGUF

sourceHugging Facellama3updated 2y agoView on Hugging Face

6likes1.1kdownloads

fileLlama3-ChatQA-1.5-70B-IQ1_M.gguf15.60 GBdownload

fileLlama3-ChatQA-1.5-70B-IQ2_S.gguf20.71 GBdownload

fileLlama3-ChatQA-1.5-70B-IQ3_M.gguf29.74 GBdownload

fileLlama3-ChatQA-1.5-70B-IQ4_NL.gguf37.30 GBdownload

fileLlama3-ChatQA-1.5-70B-Q2_K.gguf24.56 GBdownload

fileLlama3-ChatQA-1.5-70B-Q3_K_L.gguf34.59 GBdownload

fileLlama3-ChatQA-1.5-70B-Q4_K_M.gguf39.60 GBdownload

fileLlama3-ChatQA-1.5-70B-Q5_K_M.gguf46.52 GBdownload

fileLlama3-ChatQA-1.5-70B-Q6_K-00001-of-00002.gguf29.87 GBdownload

fileLlama3-ChatQA-1.5-70B-Q6_K-00002-of-00002.gguf24.04 GBdownload

fileLlama3-ChatQA-1.5-70B-Q8_0-00001-of-00003.gguf29.99 GBdownload

fileLlama3-ChatQA-1.5-70B-Q8_0-00002-of-00003.gguf29.87 GBdownload

fileLlama3-ChatQA-1.5-70B-Q8_0-00003-of-00003.gguf9.97 GBdownload

lmstudio-community/Llama3-ChatQA-1.5-70B-GGUF · main · files are served by the source, never re-hosted here