Modelpublic

nitky/Megac4ai-command-r-plus-gguf

sourceHugging Facecc-by-nc-4.0updated 2y agoView on Hugging Face

3likes89downloads

Model Card

Megac4ai-command-r-plus-gguf

These are quantized GGUF versions of nitky/Megac4ai-command-r-plus. Please check the original model for license and more details.

Model	Output Quality	Notes
Megac4ai-command-r-plus-IQ3_XS.gguf	Poor
Megac4ai-command-r-plus-IQ4_XS.gguf	Average
Megac4ai-command-r-plus-Q4KM.gguf	Good	recommended
Megac4ai-command-r-plus-Q5KM.gguf	Good
Megac4ai-command-r-plus-Q6_K.gguf	Excellent	recommended
Megac4ai-command-r-plus-Q8_0.gguf	Excellent