CoolFace
Modelpublic

Lewdiculous/MN-BackyardAI-Party-12B-v1-GGUF-IQ-ARM-Imatrix

sourceHugging Facecc-by-nc-4.0updated 2y agoView on Hugging Face
16likes2.4kdownloads
root
file.gitattributes3 KBdownload
fileARM_MN-BackyardAI-Party-12B-v1-Q4_0_4_4-imat.gguf6.59 GBdownload
fileARM_MN-BackyardAI-Party-12B-v1-Q4_0_4_8-imat.gguf6.59 GBdownload
fileARM_MN-BackyardAI-Party-12B-v1-Q4_0_8_8-imat.gguf6.59 GBdownload
fileimatrix-with-rp-v3.txt299 KBdownload
fileimatrix.dat6.7 MBdownload
fileMN-BackyardAI-Party-12B-v1-BF16.gguf22.82 GBdownload
fileMN-BackyardAI-Party-12B-v1-F16.gguf22.82 GBdownload
fileMN-BackyardAI-Party-12B-v1-IQ3_M-imat.gguf5.33 GBdownload
fileMN-BackyardAI-Party-12B-v1-IQ3_S-imat.gguf5.18 GBdownload
fileMN-BackyardAI-Party-12B-v1-IQ3_XS-imat.gguf4.94 GBdownload
fileMN-BackyardAI-Party-12B-v1-IQ3_XXS-imat.gguf4.61 GBdownload
fileMN-BackyardAI-Party-12B-v1-IQ4_XS-imat.gguf6.28 GBdownload
fileMN-BackyardAI-Party-12B-v1-Q3_K_L-imat.gguf6.11 GBdownload
fileMN-BackyardAI-Party-12B-v1-Q3_K_M-imat.gguf5.67 GBdownload
fileMN-BackyardAI-Party-12B-v1-Q4_K_M-imat.gguf6.96 GBdownload
fileMN-BackyardAI-Party-12B-v1-Q4_K_S-imat.gguf6.63 GBdownload
fileMN-BackyardAI-Party-12B-v1-Q5_K_M-imat.gguf8.13 GBdownload
fileMN-BackyardAI-Party-12B-v1-Q5_K_S-imat.gguf7.93 GBdownload
fileMN-BackyardAI-Party-12B-v1-Q6_K-imat.gguf9.37 GBdownload
fileMN-BackyardAI-Party-12B-v1-Q8_0-imat.gguf12.13 GBdownload
fileREADME.md819 Bdownload

Lewdiculous/MN-BackyardAI-Party-12B-v1-GGUF-IQ-ARM-Imatrix · main · files are served by the source, never re-hosted here