Modelpublic

bartowski/MN-12B-Lyra-v4-GGUF

sourceHugging Facecc-by-nc-4.0updated 2y agoView on Hugging Face

16likes3.6kdownloads

fileMN-12B-Lyra-v4-f16.gguf22.82 GBdownload

fileMN-12B-Lyra-v4-IQ2_M.gguf4.13 GBdownload

fileMN-12B-Lyra-v4-IQ3_M.gguf5.33 GBdownload

fileMN-12B-Lyra-v4-IQ3_XS.gguf4.94 GBdownload

fileMN-12B-Lyra-v4-IQ4_XS.gguf6.28 GBdownload

fileMN-12B-Lyra-v4-Q2_K_L.gguf5.07 GBdownload

fileMN-12B-Lyra-v4-Q2_K.gguf4.46 GBdownload

fileMN-12B-Lyra-v4-Q3_K_L.gguf6.11 GBdownload

fileMN-12B-Lyra-v4-Q3_K_M.gguf5.67 GBdownload

fileMN-12B-Lyra-v4-Q3_K_S.gguf5.15 GBdownload

fileMN-12B-Lyra-v4-Q3_K_XL.gguf6.66 GBdownload

fileMN-12B-Lyra-v4-Q4_0_4_4.gguf6.59 GBdownload

fileMN-12B-Lyra-v4-Q4_0_4_8.gguf6.59 GBdownload

fileMN-12B-Lyra-v4-Q4_0_8_8.gguf6.59 GBdownload

fileMN-12B-Lyra-v4-Q4_0.gguf6.61 GBdownload

fileMN-12B-Lyra-v4-Q4_K_L.gguf7.43 GBdownload

fileMN-12B-Lyra-v4-Q4_K_M.gguf6.96 GBdownload

fileMN-12B-Lyra-v4-Q4_K_S.gguf6.63 GBdownload

fileMN-12B-Lyra-v4-Q5_K_L.gguf8.51 GBdownload

fileMN-12B-Lyra-v4-Q5_K_M.gguf8.13 GBdownload

fileMN-12B-Lyra-v4-Q5_K_S.gguf7.93 GBdownload

fileMN-12B-Lyra-v4-Q6_K_L.gguf9.67 GBdownload

fileMN-12B-Lyra-v4-Q6_K.gguf9.37 GBdownload

fileMN-12B-Lyra-v4-Q8_0.gguf12.13 GBdownload

bartowski/MN-12B-Lyra-v4-GGUF · main · files are served by the source, never re-hosted here