CoolFace
Modelpublic

PrunaAI/Phi-3-mini-4k-instruct-GGUF-Imatrix-smashed

sourceHugging Faceupdated 6mo agoView on Hugging Face
6likes18kdownloads
root
file.gitattributes3 KBdownload
filePhi-3-mini-4k-instruct.fp16.bin7.12 GBdownload
filePhi-3-mini-4k-instruct.imatrix.dat2.1 MBdownload
filePhi-3-mini-4k-instruct.IQ1_M.gguf874.6 MBdownload
filePhi-3-mini-4k-instruct.IQ1_S.gguf802.6 MBdownload
filePhi-3-mini-4k-instruct.IQ2_M.gguf1.23 GBdownload
filePhi-3-mini-4k-instruct.IQ2_S.gguf1.13 GBdownload
filePhi-3-mini-4k-instruct.IQ2_XS.gguf1.07 GBdownload
filePhi-3-mini-4k-instruct.IQ2_XXS.gguf994.6 MBdownload
filePhi-3-mini-4k-instruct.IQ3_M.gguf1.73 GBdownload
filePhi-3-mini-4k-instruct.IQ3_S.gguf1.57 GBdownload
filePhi-3-mini-4k-instruct.IQ3_XS.gguf1.51 GBdownload
filePhi-3-mini-4k-instruct.IQ3_XXS.gguf1.41 GBdownload
filePhi-3-mini-4k-instruct.IQ4_NL.gguf2.03 GBdownload
filePhi-3-mini-4k-instruct.IQ4_XS.gguf1.92 GBdownload
filePhi-3-mini-4k-instruct.Q2_K.gguf1.32 GBdownload
filePhi-3-mini-4k-instruct.Q3_K_L.gguf1.94 GBdownload
filePhi-3-mini-4k-instruct.Q3_K_M.gguf1.82 GBdownload
filePhi-3-mini-4k-instruct.Q3_K_S.gguf1.57 GBdownload
filePhi-3-mini-4k-instruct.Q4_0.gguf2.03 GBdownload
filePhi-3-mini-4k-instruct.Q4_1.gguf2.24 GBdownload
filePhi-3-mini-4k-instruct.Q4_K_M.gguf2.23 GBdownload
filePhi-3-mini-4k-instruct.Q4_K_S.gguf2.04 GBdownload
filePhi-3-mini-4k-instruct.Q5_0.gguf2.47 GBdownload
filePhi-3-mini-4k-instruct.Q5_1.gguf2.68 GBdownload
filePhi-3-mini-4k-instruct.Q5_K_M.gguf2.62 GBdownload
filePhi-3-mini-4k-instruct.Q5_K_S.gguf2.46 GBdownload
filePhi-3-mini-4k-instruct.Q6_K.gguf2.92 GBdownload
filePhi-3-mini-4k-instruct.Q8_0.gguf3.78 GBdownload
fileREADME.md18 KBdownload

PrunaAI/Phi-3-mini-4k-instruct-GGUF-Imatrix-smashed · main · files are served by the source, never re-hosted here