Modelpublic

mradermacher/InSight-doc-8B-GGUF

sourceHugging Faceapache-2.0updated 2mo agoView on Hugging Face

2likes934downloads

fileInSight-doc-8B.f16.gguf15.26 GBdownload

fileInSight-doc-8B.IQ4_XS.gguf4.28 GBdownload

fileInSight-doc-8B.mmproj-f16.gguf1.08 GBdownload

fileInSight-doc-8B.mmproj-Q8_0.gguf717.4 MBdownload

fileInSight-doc-8B.Q2_K.gguf3.06 GBdownload

fileInSight-doc-8B.Q3_K_L.gguf4.13 GBdownload

fileInSight-doc-8B.Q3_K_M.gguf3.84 GBdownload

fileInSight-doc-8B.Q3_K_S.gguf3.51 GBdownload

fileInSight-doc-8B.Q4_K_M.gguf4.68 GBdownload

fileInSight-doc-8B.Q4_K_S.gguf4.47 GBdownload

fileInSight-doc-8B.Q5_K_M.gguf5.45 GBdownload

fileInSight-doc-8B.Q5_K_S.gguf5.33 GBdownload

fileInSight-doc-8B.Q6_K.gguf6.26 GBdownload

fileInSight-doc-8B.Q8_0.gguf8.11 GBdownload

mradermacher/InSight-doc-8B-GGUF · main · files are served by the source, never re-hosted here