Modelpublic

mradermacher/GPT-5-Distill-llama3.2-3B-Instruct-Heretic-GGUF

sourceHugging Facellama3.2updated 10mo agoView on Hugging Face

1likes659downloads

fileGPT-5-Distill-llama3.2-3B-Instruct-Heretic.f16.gguf5.99 GBdownload

fileGPT-5-Distill-llama3.2-3B-Instruct-Heretic.IQ4_XS.gguf1.71 GBdownload

fileGPT-5-Distill-llama3.2-3B-Instruct-Heretic.Q2_K.gguf1.27 GBdownload

fileGPT-5-Distill-llama3.2-3B-Instruct-Heretic.Q3_K_L.gguf1.69 GBdownload

fileGPT-5-Distill-llama3.2-3B-Instruct-Heretic.Q3_K_M.gguf1.57 GBdownload

fileGPT-5-Distill-llama3.2-3B-Instruct-Heretic.Q3_K_S.gguf1.44 GBdownload

fileGPT-5-Distill-llama3.2-3B-Instruct-Heretic.Q4_K_M.gguf1.88 GBdownload

fileGPT-5-Distill-llama3.2-3B-Instruct-Heretic.Q4_K_S.gguf1.80 GBdownload

fileGPT-5-Distill-llama3.2-3B-Instruct-Heretic.Q5_K_M.gguf2.16 GBdownload

fileGPT-5-Distill-llama3.2-3B-Instruct-Heretic.Q5_K_S.gguf2.11 GBdownload

fileGPT-5-Distill-llama3.2-3B-Instruct-Heretic.Q6_K.gguf2.46 GBdownload

fileGPT-5-Distill-llama3.2-3B-Instruct-Heretic.Q8_0.gguf3.19 GBdownload

mradermacher/GPT-5-Distill-llama3.2-3B-Instruct-Heretic-GGUF · main · files are served by the source, never re-hosted here