Modelpublic

mradermacher/Bio-Medical-Llama-3.1-8B-GGUF

sourceHugging Faceotherupdated 2y agoView on Hugging Face

2likes1.1kdownloads

fileBio-Medical-Llama-3.1-8B.f16.gguf14.97 GBdownload

fileBio-Medical-Llama-3.1-8B.IQ3_M.gguf3.52 GBdownload

fileBio-Medical-Llama-3.1-8B.IQ3_S.gguf3.43 GBdownload

fileBio-Medical-Llama-3.1-8B.IQ3_XS.gguf3.28 GBdownload

fileBio-Medical-Llama-3.1-8B.IQ4_XS.gguf4.18 GBdownload

fileBio-Medical-Llama-3.1-8B.Q2_K.gguf2.96 GBdownload

fileBio-Medical-Llama-3.1-8B.Q3_K_L.gguf4.03 GBdownload

fileBio-Medical-Llama-3.1-8B.Q3_K_M.gguf3.74 GBdownload

fileBio-Medical-Llama-3.1-8B.Q3_K_S.gguf3.41 GBdownload

fileBio-Medical-Llama-3.1-8B.Q4_K_M.gguf4.58 GBdownload

fileBio-Medical-Llama-3.1-8B.Q4_K_S.gguf4.37 GBdownload

fileBio-Medical-Llama-3.1-8B.Q5_K_M.gguf5.34 GBdownload

fileBio-Medical-Llama-3.1-8B.Q5_K_S.gguf5.21 GBdownload

fileBio-Medical-Llama-3.1-8B.Q6_K.gguf6.14 GBdownload

fileBio-Medical-Llama-3.1-8B.Q8_0.gguf7.95 GBdownload

mradermacher/Bio-Medical-Llama-3.1-8B-GGUF · main · files are served by the source, never re-hosted here