CoolFace
Modelpublic

hermes42/Phi-3-medium-128k-instruct-imatrix-GGUF

sourceHugging Facemitupdated 2y agoView on Hugging Face
1likes1.6kdownloads
root
file.gitattributes4 KBdownload
filegroup_10_merged.txt158 KBdownload
filePhi-3-medium-128k-instruct-imatrix-IQ1_M.gguf3.02 GBdownload
filePhi-3-medium-128k-instruct-imatrix-IQ1_S.gguf2.75 GBdownload
filePhi-3-medium-128k-instruct-imatrix-IQ2_M.gguf4.39 GBdownload
filePhi-3-medium-128k-instruct-imatrix-IQ2_S.gguf4.04 GBdownload
filePhi-3-medium-128k-instruct-imatrix-IQ2_XS.gguf3.84 GBdownload
filePhi-3-medium-128k-instruct-imatrix-IQ2_XXS.gguf3.46 GBdownload
filePhi-3-medium-128k-instruct-imatrix-IQ3_M.gguf6.03 GBdownload
filePhi-3-medium-128k-instruct-imatrix-IQ3_S.gguf5.65 GBdownload
filePhi-3-medium-128k-instruct-imatrix-IQ3_XS.gguf5.41 GBdownload
filePhi-3-medium-128k-instruct-imatrix-IQ3_XXS.gguf5.08 GBdownload
filePhi-3-medium-128k-instruct-imatrix-IQ4_NL.gguf7.35 GBdownload
filePhi-3-medium-128k-instruct-imatrix-IQ4_XS.gguf6.95 GBdownload
filePhi-3-medium-128k-instruct-imatrix-Q2_K_S.gguf4.44 GBdownload
filePhi-3-medium-128k-instruct-imatrix-Q2_K.gguf4.79 GBdownload
filePhi-3-medium-128k-instruct-imatrix-Q3_K_L.gguf6.98 GBdownload
filePhi-3-medium-128k-instruct-imatrix-Q3_K_M.gguf6.45 GBdownload
filePhi-3-medium-128k-instruct-imatrix-Q3_K_S.gguf5.65 GBdownload
filePhi-3-medium-128k-instruct-imatrix-Q4_0.gguf7.38 GBdownload
filePhi-3-medium-128k-instruct-imatrix-Q4_1.gguf8.16 GBdownload
filePhi-3-medium-128k-instruct-imatrix-Q4_K_M.gguf7.98 GBdownload
filePhi-3-medium-128k-instruct-imatrix-Q4_K_S.gguf7.41 GBdownload
filePhi-3-medium-128k-instruct-imatrix-Q5_0.gguf8.99 GBdownload
filePhi-3-medium-128k-instruct-imatrix-Q5_1.gguf9.76 GBdownload
filePhi-3-medium-128k-instruct-imatrix-Q5_K_M.gguf9.38 GBdownload
filePhi-3-medium-128k-instruct-imatrix-Q5_K_S.gguf8.96 GBdownload
filePhi-3-medium-128k-instruct-imatrix-Q6_K.gguf10.67 GBdownload
filePhi-3-medium-128k-instruct-imatrix-Q8_0.gguf13.82 GBdownload
filePhi-3-medium-128k-instruct.bf16.gguf26.00 GBdownload
filePhi-3-medium-128k-instruct.imatrix.dat5.1 MBdownload
fileREADME.md19 KBdownload

hermes42/Phi-3-medium-128k-instruct-imatrix-GGUF · main · files are served by the source, never re-hosted here