Modelpublic

mradermacher/LLaDA-MoE-7B-A1B-Instruct-GGUF

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face

6likes764downloads

fileLLaDA-MoE-7B-A1B-Instruct.f16.gguf13.71 GBdownload

fileLLaDA-MoE-7B-A1B-Instruct.IQ4_XS.gguf3.78 GBdownload

fileLLaDA-MoE-7B-A1B-Instruct.Q2_K.gguf2.63 GBdownload

fileLLaDA-MoE-7B-A1B-Instruct.Q3_K_L.gguf3.62 GBdownload

fileLLaDA-MoE-7B-A1B-Instruct.Q3_K_M.gguf3.37 GBdownload

fileLLaDA-MoE-7B-A1B-Instruct.Q3_K_S.gguf3.07 GBdownload

fileLLaDA-MoE-7B-A1B-Instruct.Q4_K_M.gguf4.21 GBdownload

fileLLaDA-MoE-7B-A1B-Instruct.Q4_K_S.gguf3.98 GBdownload

fileLLaDA-MoE-7B-A1B-Instruct.Q5_K_M.gguf4.90 GBdownload

fileLLaDA-MoE-7B-A1B-Instruct.Q5_K_S.gguf4.76 GBdownload

fileLLaDA-MoE-7B-A1B-Instruct.Q6_K.gguf5.63 GBdownload

fileLLaDA-MoE-7B-A1B-Instruct.Q8_0.gguf7.29 GBdownload

mradermacher/LLaDA-MoE-7B-A1B-Instruct-GGUF · main · files are served by the source, never re-hosted here