Modelpublic

mradermacher/Bitnet-Llama-7B-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face

1likes291downloads

fileBitnet-Llama-7B.f16.gguf148.5 MBdownload

fileBitnet-Llama-7B.IQ4_XS.gguf46.7 MBdownload

fileBitnet-Llama-7B.Q2_K.gguf37.6 MBdownload

fileBitnet-Llama-7B.Q3_K_L.gguf44.5 MBdownload

fileBitnet-Llama-7B.Q3_K_M.gguf43.2 MBdownload

fileBitnet-Llama-7B.Q3_K_S.gguf41.6 MBdownload

fileBitnet-Llama-7B.Q4_K_M.gguf49.0 MBdownload

fileBitnet-Llama-7B.Q4_K_S.gguf48.6 MBdownload

fileBitnet-Llama-7B.Q5_K_M.gguf55.0 MBdownload

fileBitnet-Llama-7B.Q5_K_S.gguf54.6 MBdownload

fileBitnet-Llama-7B.Q6_K.gguf61.3 MBdownload

fileBitnet-Llama-7B.Q8_0.gguf79.2 MBdownload

mradermacher/Bitnet-Llama-7B-GGUF · main · files are served by the source, never re-hosted here