Modelpublic

mradermacher/Monstral-123B-v2-i1-GGUF

sourceHugging Faceotherupdated 2y agoView on Hugging Face

1likes347downloads

file.gitattributes4 KBdownload

fileimatrix.dat34.4 MBdownload

fileMonstral-123B-v2.i1-IQ1_M.gguf26.44 GBdownload

fileMonstral-123B-v2.i1-IQ1_S.gguf24.18 GBdownload

fileMonstral-123B-v2.i1-IQ2_M.gguf38.76 GBdownload

fileMonstral-123B-v2.i1-IQ2_S.gguf35.75 GBdownload

fileMonstral-123B-v2.i1-IQ2_XS.gguf33.60 GBdownload

fileMonstral-123B-v2.i1-IQ2_XXS.gguf30.20 GBdownload

fileMonstral-123B-v2.i1-IQ3_M.gguf.part1of226.00 GBdownload

fileMonstral-123B-v2.i1-IQ3_M.gguf.part2of225.48 GBdownload

fileMonstral-123B-v2.i1-IQ3_S.gguf.part1of225.00 GBdownload

fileMonstral-123B-v2.i1-IQ3_S.gguf.part2of224.36 GBdownload

fileMonstral-123B-v2.i1-IQ3_XS.gguf.part1of224.00 GBdownload

fileMonstral-123B-v2.i1-IQ3_XS.gguf.part2of222.70 GBdownload

fileMonstral-123B-v2.i1-IQ3_XXS.gguf43.78 GBdownload

fileMonstral-123B-v2.i1-IQ4_XS.gguf.part1of231.00 GBdownload

fileMonstral-123B-v2.i1-IQ4_XS.gguf.part2of229.94 GBdownload

fileMonstral-123B-v2.i1-Q2_K_S.gguf38.75 GBdownload

fileMonstral-123B-v2.i1-Q2_K.gguf42.09 GBdownload

fileMonstral-123B-v2.i1-Q3_K_L.gguf.part1of231.00 GBdownload

fileMonstral-123B-v2.i1-Q3_K_L.gguf.part2of229.12 GBdownload

fileMonstral-123B-v2.i1-Q3_K_M.gguf.part1of228.00 GBdownload

fileMonstral-123B-v2.i1-Q3_K_M.gguf.part2of227.04 GBdownload

fileMonstral-123B-v2.i1-Q3_K_S.gguf.part1of225.00 GBdownload

fileMonstral-123B-v2.i1-Q3_K_S.gguf.part2of224.22 GBdownload

fileMonstral-123B-v2.i1-Q4_0.gguf.part1of233.00 GBdownload

fileMonstral-123B-v2.i1-Q4_0.gguf.part2of231.56 GBdownload

fileMonstral-123B-v2.i1-Q4_K_M.gguf.part1of235.00 GBdownload

fileMonstral-123B-v2.i1-Q4_K_M.gguf.part2of233.19 GBdownload

fileMonstral-123B-v2.i1-Q4_K_S.gguf.part1of233.00 GBdownload

fileMonstral-123B-v2.i1-Q4_K_S.gguf.part2of231.79 GBdownload

fileMonstral-123B-v2.i1-Q5_K_M.gguf.part1of241.00 GBdownload

fileMonstral-123B-v2.i1-Q5_K_M.gguf.part2of239.55 GBdownload

fileMonstral-123B-v2.i1-Q5_K_S.gguf.part1of240.00 GBdownload

fileMonstral-123B-v2.i1-Q5_K_S.gguf.part2of238.56 GBdownload

fileMonstral-123B-v2.i1-Q6_K.gguf.part1of332.00 GBdownload

fileMonstral-123B-v2.i1-Q6_K.gguf.part2of332.00 GBdownload

fileMonstral-123B-v2.i1-Q6_K.gguf.part3of329.68 GBdownload

fileREADME.md7 KBdownload

mradermacher/Monstral-123B-v2-i1-GGUF · main · files are served by the source, never re-hosted here