Modelpublic

mradermacher/Midnight-Miqu-70B-v1.5_ChatML-GGUF

sourceHugging Faceupdated 7mo agoView on Hugging Face

0likes403downloads

fileMidnight-Miqu-70B-v1.5_ChatML.IQ4_XS.gguf34.64 GBdownload

fileMidnight-Miqu-70B-v1.5_ChatML.Q2_K.gguf23.71 GBdownload

fileMidnight-Miqu-70B-v1.5_ChatML.Q3_K_L.gguf33.67 GBdownload

fileMidnight-Miqu-70B-v1.5_ChatML.Q3_K_M.gguf30.99 GBdownload

fileMidnight-Miqu-70B-v1.5_ChatML.Q3_K_S.gguf27.86 GBdownload

fileMidnight-Miqu-70B-v1.5_ChatML.Q4_K_M.gguf38.58 GBdownload

fileMidnight-Miqu-70B-v1.5_ChatML.Q4_K_S.gguf36.55 GBdownload

fileMidnight-Miqu-70B-v1.5_ChatML.Q5_K_M.gguf45.41 GBdownload

fileMidnight-Miqu-70B-v1.5_ChatML.Q5_K_S.gguf44.20 GBdownload

fileMidnight-Miqu-70B-v1.5_ChatML.Q6_K.gguf52.70 GBdownload

fileMidnight-Miqu-70B-v1.5_ChatML.Q8_0.gguf68.26 GBdownload

mradermacher/Midnight-Miqu-70B-v1.5_ChatML-GGUF · main · files are served by the source, never re-hosted here