Modelpublic

QuantFactory/starling-7b-raft-ft-GGUF

sourceHugging Faceupdated 2y agoView on Hugging Face

1likes394downloads

filestarling-7b-raft-ft.Q2_K.gguf2.96 GBdownload

filestarling-7b-raft-ft.Q3_K_L.gguf4.03 GBdownload

filestarling-7b-raft-ft.Q3_K_M.gguf3.74 GBdownload

filestarling-7b-raft-ft.Q3_K_S.gguf3.41 GBdownload

filestarling-7b-raft-ft.Q4_0.gguf4.34 GBdownload

filestarling-7b-raft-ft.Q4_1.gguf4.78 GBdownload

filestarling-7b-raft-ft.Q4_K_M.gguf4.58 GBdownload

filestarling-7b-raft-ft.Q4_K_S.gguf4.37 GBdownload

filestarling-7b-raft-ft.Q5_0.gguf5.21 GBdownload

filestarling-7b-raft-ft.Q5_1.gguf5.65 GBdownload

filestarling-7b-raft-ft.Q5_K_M.gguf5.34 GBdownload

filestarling-7b-raft-ft.Q5_K_S.gguf5.21 GBdownload

filestarling-7b-raft-ft.Q6_K.gguf6.14 GBdownload

filestarling-7b-raft-ft.Q8_0.gguf7.95 GBdownload

QuantFactory/starling-7b-raft-ft-GGUF · main · files are served by the source, never re-hosted here