gghfez/DeepSeek-R1-Zero-IQ3_KS

ik_llama.cpp imatrix MLA Quantizations of deepseek-ai/DeepSeek-R1-Zero

This is an IQ3KS quant of deepseek-ai/DeepSeek-R1-Zero using [ubergarm](https://huggingface.co/ubergarm)'s IQ3KS recipe from ubergarm/DeepSeek-TNG-R1T2-Chimera-GGUF.

This quant collection REQUIRES ik_llama.cpp fork to support advanced non-linear SotA quants and Multi-Head Latent Attention (MLA). Do not download these big files and expect them to run on mainline vanilla llama.cpp, ollama, LM Studio, KoboldCpp, etc!

I've uploaded the converted BF16 weights gghfez/DeepSeek-R1-Zero-256x21B-BF16 if I, or anyone else wants to create similar quants in the future.

Note: I may be deleting gghfez/DeepSeek-R1-Zero-256x21B-BF16 shortly due to the new huggingface storage limits.