CoolFace
Modelpublic

mradermacher/Mistral-7B-Instruct-v0.2-sliced-24-layer-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes364downloads
root
file.gitattributes3 KBdownload
fileMistral-7B-Instruct-v0.2-sliced-24-layer.f16.gguf10.24 GBdownload
fileMistral-7B-Instruct-v0.2-sliced-24-layer.IQ4_XS.gguf2.80 GBdownload
fileMistral-7B-Instruct-v0.2-sliced-24-layer.Q2_K.gguf1.93 GBdownload
fileMistral-7B-Instruct-v0.2-sliced-24-layer.Q3_K_L.gguf2.71 GBdownload
fileMistral-7B-Instruct-v0.2-sliced-24-layer.Q3_K_M.gguf2.49 GBdownload
fileMistral-7B-Instruct-v0.2-sliced-24-layer.Q3_K_S.gguf2.25 GBdownload
fileMistral-7B-Instruct-v0.2-sliced-24-layer.Q4_K_M.gguf3.09 GBdownload
fileMistral-7B-Instruct-v0.2-sliced-24-layer.Q4_K_S.gguf2.93 GBdownload
fileMistral-7B-Instruct-v0.2-sliced-24-layer.Q5_K_M.gguf3.63 GBdownload
fileMistral-7B-Instruct-v0.2-sliced-24-layer.Q5_K_S.gguf3.54 GBdownload
fileMistral-7B-Instruct-v0.2-sliced-24-layer.Q6_K.gguf4.20 GBdownload
fileMistral-7B-Instruct-v0.2-sliced-24-layer.Q8_0.gguf5.44 GBdownload
fileREADME.md4 KBdownload

mradermacher/Mistral-7B-Instruct-v0.2-sliced-24-layer-GGUF · main · files are served by the source, never re-hosted here