CoolFace
Modelpublic

mradermacher/bigstral-12b-32k-8xMoE-i1-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes160downloads
root
file.gitattributes3 KBdownload
filebigstral-12b-32k-8xMoE.i1-IQ1_M.gguf17.59 GBdownload
filebigstral-12b-32k-8xMoE.i1-IQ1_S.gguf15.91 GBdownload
filebigstral-12b-32k-8xMoE.i1-IQ2_M.gguf25.15 GBdownload
filebigstral-12b-32k-8xMoE.i1-IQ2_S.gguf22.92 GBdownload
filebigstral-12b-32k-8xMoE.i1-IQ2_XS.gguf22.60 GBdownload
filebigstral-12b-32k-8xMoE.i1-IQ2_XXS.gguf20.37 GBdownload
filebigstral-12b-32k-8xMoE.i1-IQ3_M.gguf34.81 GBdownload
filebigstral-12b-32k-8xMoE.i1-IQ3_S.gguf33.19 GBdownload
filebigstral-12b-32k-8xMoE.i1-IQ3_XS.gguf31.42 GBdownload
filebigstral-12b-32k-8xMoE.i1-IQ3_XXS.gguf29.63 GBdownload
filebigstral-12b-32k-8xMoE.i1-IQ4_XS.gguf40.75 GBdownload
filebigstral-12b-32k-8xMoE.i1-Q2_K.gguf28.11 GBdownload
filebigstral-12b-32k-8xMoE.i1-Q3_K_L.gguf39.28 GBdownload
filebigstral-12b-32k-8xMoE.i1-Q3_K_M.gguf36.60 GBdownload
filebigstral-12b-32k-8xMoE.i1-Q3_K_S.gguf33.19 GBdownload
filebigstral-12b-32k-8xMoE.i1-Q4_0.gguf43.16 GBdownload
filebigstral-12b-32k-8xMoE.i1-Q4_K_M.gguf46.24 GBdownload
filebigstral-12b-32k-8xMoE.i1-Q4_K_S.gguf43.46 GBdownload
filebigstral-12b-32k-8xMoE.i1-Q5_K_M.gguf.part1of228.00 GBdownload
filebigstral-12b-32k-8xMoE.i1-Q5_K_M.gguf.part2of226.02 GBdownload
filebigstral-12b-32k-8xMoE.i1-Q5_K_S.gguf.part1of227.00 GBdownload
filebigstral-12b-32k-8xMoE.i1-Q5_K_S.gguf.part2of225.39 GBdownload
filebigstral-12b-32k-8xMoE.i1-Q6_K.gguf.part1of232.00 GBdownload
filebigstral-12b-32k-8xMoE.i1-Q6_K.gguf.part2of230.40 GBdownload
fileimatrix.dat42.9 MBdownload
fileREADME.md6 KBdownload

mradermacher/bigstral-12b-32k-8xMoE-i1-GGUF · main · files are served by the source, never re-hosted here