Modelpublic

matrixportalx/Ben-Maya-GGUF

sourceHugging Faceupdated 1y agoView on Hugging Face

1likes229downloads

Model Card

Ben-Maya GGUF Quantized Models

Technical Details

—Quantization Tool: llama.cpp
—Version: version: 5158 (00137157)

Model Information

—Base Model: matrixportal/Ben-Maya
—Quantized by: matrixportal

Available Files

🚀 Download	🔢 Type	📝 Description
Download	Q2 K	Tiny size, lowest quality (emergency use only)
Download	Q3 K S	Very small, low quality (basic tasks)
Download	Q3 K M	Small, acceptable quality
Download	Q3 K L	Small, better than Q3KM (good for low RAM)
Download	Q4 0	Standard 4-bit (fast on ARM)
Download	Q4 K S	4-bit optimized (good space savings)
Download	Q4 K M	4-bit balanced (recommended default)
Download	Q5 0	5-bit high quality
Download	Q5 K S	5-bit optimized
Download	Q5 K M	5-bit best (recommended HQ option)
Download	Q6 K	6-bit near-perfect (premium quality)
Download	Q8 0	8-bit maximum (overkill for most)
Download	F16	Full precision (maximum accuracy)

💡 Q4 K M provides the best balance for most use cases