Modelpublic

mradermacher/TowerInstruct-7B-v0.2-GGUF

sourceHugging Facecc-by-nc-4.0updated 2y agoView on Hugging Face

3likes3kdownloads

fileTowerInstruct-7B-v0.2.f16.gguf12.55 GBdownload

fileTowerInstruct-7B-v0.2.IQ3_M.gguf2.90 GBdownload

fileTowerInstruct-7B-v0.2.IQ3_S.gguf2.75 GBdownload

fileTowerInstruct-7B-v0.2.IQ3_XS.gguf2.60 GBdownload

fileTowerInstruct-7B-v0.2.IQ4_XS.gguf3.40 GBdownload

fileTowerInstruct-7B-v0.2.Q2_K.gguf2.36 GBdownload

fileTowerInstruct-7B-v0.2.Q3_K_L.gguf3.35 GBdownload

fileTowerInstruct-7B-v0.2.Q3_K_M.gguf3.07 GBdownload

fileTowerInstruct-7B-v0.2.Q3_K_S.gguf2.75 GBdownload

fileTowerInstruct-7B-v0.2.Q4_K_M.gguf3.80 GBdownload

fileTowerInstruct-7B-v0.2.Q4_K_S.gguf3.59 GBdownload

fileTowerInstruct-7B-v0.2.Q5_K_M.gguf4.45 GBdownload

fileTowerInstruct-7B-v0.2.Q5_K_S.gguf4.33 GBdownload

fileTowerInstruct-7B-v0.2.Q6_K.gguf5.15 GBdownload

fileTowerInstruct-7B-v0.2.Q8_0.gguf6.67 GBdownload

mradermacher/TowerInstruct-7B-v0.2-GGUF · main · files are served by the source, never re-hosted here