Modelpublic

mradermacher/G4-Starry-Ocean-12B-GGUF

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face

1likes831downloads

fileG4-Starry-Ocean-12B.IQ4_XS.gguf6.23 GBdownload

fileG4-Starry-Ocean-12B.mmproj-f16.gguf2 KBdownload

fileG4-Starry-Ocean-12B.mmproj-Q8_0.gguf2 KBdownload

fileG4-Starry-Ocean-12B.Q2_K.gguf4.50 GBdownload

fileG4-Starry-Ocean-12B.Q3_K_L.gguf6.12 GBdownload

fileG4-Starry-Ocean-12B.Q3_K_M.gguf5.67 GBdownload

fileG4-Starry-Ocean-12B.Q3_K_S.gguf5.15 GBdownload

fileG4-Starry-Ocean-12B.Q4_K_M.gguf6.87 GBdownload

fileG4-Starry-Ocean-12B.Q4_K_S.gguf6.54 GBdownload

fileG4-Starry-Ocean-12B.Q5_K_M.gguf7.96 GBdownload

fileG4-Starry-Ocean-12B.Q5_K_S.gguf7.77 GBdownload

fileG4-Starry-Ocean-12B.Q6_K.gguf9.11 GBdownload

fileG4-Starry-Ocean-12B.Q8_0.gguf11.80 GBdownload

mradermacher/G4-Starry-Ocean-12B-GGUF · main · files are served by the source, never re-hosted here