Modelpublic

ThomasBaruzier/Llama-3.2-1B-Instruct-GGUF

sourceHugging Facellama3.2updated 2y agoView on Hugging Face

0likes3.7kdownloads

fileLlama-3.2-1B-Instruct-F16.gguf2.31 GBdownload

fileLlama-3.2-1B-Instruct-IQ1_M.gguf394.4 MBdownload

fileLlama-3.2-1B-Instruct-IQ1_S.gguf375.3 MBdownload

fileLlama-3.2-1B-Instruct-IQ2_M.gguf491.6 MBdownload

fileLlama-3.2-1B-Instruct-IQ2_S.gguf466.1 MBdownload

fileLlama-3.2-1B-Instruct-IQ2_XS.gguf453.8 MBdownload

fileLlama-3.2-1B-Instruct-IQ2_XXS.gguf426.3 MBdownload

fileLlama-3.2-1B-Instruct-IQ3_M.gguf626.8 MBdownload

fileLlama-3.2-1B-Instruct-IQ3_S.gguf614.1 MBdownload

fileLlama-3.2-1B-Instruct-IQ3_XS.gguf592.3 MBdownload

fileLlama-3.2-1B-Instruct-IQ3_XXS.gguf536.1 MBdownload

fileLlama-3.2-1B-Instruct-IQ4_NL.gguf737.2 MBdownload

fileLlama-3.2-1B-Instruct-IQ4_XS.gguf708.7 MBdownload

fileLlama-3.2-1B-Instruct-Q2_K_S.gguf529.0 MBdownload

fileLlama-3.2-1B-Instruct-Q2_K.gguf554.0 MBdownload

fileLlama-3.2-1B-Instruct-Q3_K_L.gguf698.6 MBdownload

fileLlama-3.2-1B-Instruct-Q3_K_M.gguf658.8 MBdownload

fileLlama-3.2-1B-Instruct-Q3_K_S.gguf612.0 MBdownload

fileLlama-3.2-1B-Instruct-Q4_0_4_4.gguf735.2 MBdownload

fileLlama-3.2-1B-Instruct-Q4_0_4_8.gguf735.2 MBdownload

fileLlama-3.2-1B-Instruct-Q4_0_8_8.gguf735.2 MBdownload

fileLlama-3.2-1B-Instruct-Q4_0.gguf737.2 MBdownload

fileLlama-3.2-1B-Instruct-Q4_1.gguf793.2 MBdownload

fileLlama-3.2-1B-Instruct-Q4_K_M.gguf770.3 MBdownload

fileLlama-3.2-1B-Instruct-Q4_K_S.gguf739.7 MBdownload

fileLlama-3.2-1B-Instruct-Q5_0.gguf853.2 MBdownload

fileLlama-3.2-1B-Instruct-Q5_1.gguf909.2 MBdownload

fileLlama-3.2-1B-Instruct-Q5_K_M.gguf869.3 MBdownload

fileLlama-3.2-1B-Instruct-Q5_K_S.gguf851.2 MBdownload

fileLlama-3.2-1B-Instruct-Q6_K.gguf974.5 MBdownload

fileLlama-3.2-1B-Instruct-Q8_0.gguf1.23 GBdownload

ThomasBaruzier/Llama-3.2-1B-Instruct-GGUF · main · files are served by the source, never re-hosted here