CoolFace
Modelpublic

ysn-rfd/HelpingAI2.5-5B-GGUF

sourceHugging Faceotherupdated 1y agoView on Hugging Face
1likes62downloads
Model Card

ysn-rfd/HelpingAI2.5-5B-GGUF

This model was converted to GGUF format from `HelpingAI/HelpingAI2.5-5B` using llama.cpp via the ggml.ai's all-gguf-same-where space. Refer to the original model card for more details on the model.

✅ Quantized Models Download List

✨ Recommended for CPU: Q4_K_M | ⚡ Recommended for ARM CPU: Q4_0 | 🏆 Best Quality: Q8_0

🚀 Download🔢 Type📝 Notes
DownloadQ2_KBasic quantization
DownloadQ3_K_SSmall size
DownloadQ3_K_MBalanced quality
DownloadQ3_K_LBetter quality
DownloadQ4_0Fast on ARM
DownloadQ4_K_SFast, recommended
DownloadQ4_K_MBest balance
DownloadQ5_0Good quality
DownloadQ5_K_SBalanced
DownloadQ5_K_MHigh quality
DownloadQ6_K 🏆Very good quality
DownloadQ8_0Fast, best quality
DownloadF16Maximum accuracy

💡 Tip: Use F16 for maximum precision when quality is critical