CoolFace
Modelpublic

matrixportalx/aya-23-8B-GGUF

sourceHugging Facecc-by-nc-4.0updated 2y agoView on Hugging Face
0likes826downloads
Model Card

matrixportal/aya-23-8B-GGUF

This model was converted to GGUF format from `CohereForAI/aya-23-8B` using llama.cpp via the ggml.ai's all-gguf-same-where space. Refer to the original model card for more details on the model.

✅ Quantized Models Download List

✨ Recommended for CPU: Q4_K_M | ⚡ Recommended for ARM CPU: Q4_0 | 🏆 Best Quality: Q8_0

🚀 Download🔢 Type📝 Notes
DownloadQ2_KBasic quantization
DownloadQ3_K_SSmall size
DownloadQ3_K_MBalanced quality
DownloadQ3_K_LBetter quality
DownloadQ4_0Fast on ARM
DownloadQ4_K_SFast, recommended
DownloadQ4_K_M ⭐Best balance
DownloadQ5_0Good quality
DownloadQ5_K_SBalanced
DownloadQ5_K_MHigh quality
DownloadQ6_K 🏆Very good quality
DownloadQ8_0 ⚡Fast, best quality
DownloadF16Maximum accuracy

💡 Tip: Use F16 for maximum precision when quality is critical