Modelpublic

mradermacher/lmsys-vicuna-13b-v1.5-16k-GGUF

sourceHugging Facellama2updated 2y agoView on Hugging Face

0likes44downloads

filelmsys-vicuna-13b-v1.5-16k.IQ4_XS.gguf6.54 GBdownload

filelmsys-vicuna-13b-v1.5-16k.Q2_K.gguf4.52 GBdownload

filelmsys-vicuna-13b-v1.5-16k.Q3_K_L.gguf6.45 GBdownload

filelmsys-vicuna-13b-v1.5-16k.Q3_K_M.gguf5.90 GBdownload

filelmsys-vicuna-13b-v1.5-16k.Q3_K_S.gguf5.27 GBdownload

filelmsys-vicuna-13b-v1.5-16k.Q4_0_4_4.gguf6.86 GBdownload

filelmsys-vicuna-13b-v1.5-16k.Q4_K_M.gguf7.33 GBdownload

filelmsys-vicuna-13b-v1.5-16k.Q4_K_S.gguf6.91 GBdownload

filelmsys-vicuna-13b-v1.5-16k.Q5_K_M.gguf8.60 GBdownload

filelmsys-vicuna-13b-v1.5-16k.Q5_K_S.gguf8.36 GBdownload

filelmsys-vicuna-13b-v1.5-16k.Q6_K.gguf9.95 GBdownload

filelmsys-vicuna-13b-v1.5-16k.Q8_0.gguf12.88 GBdownload

mradermacher/lmsys-vicuna-13b-v1.5-16k-GGUF · main · files are served by the source, never re-hosted here