matrixportalx/Llama-3.2-3B-Instruct-GGUF
0295
- Base model: meta-llama/Llama-3.2-3B-Instruct
- License: Llama 3 Community License
Quantized with llama.cpp using all-gguf-same-where
✅ Quantized Models Download List
🔍 Recommended Quantizations
- ✨ General CPU Use: `Q4_K_M` (Best balance of speed/quality)
- 📱 ARM Devices: `Q4_0` (Optimized for ARM CPUs)
- 🏆 Maximum Quality: `Q8_0` (Near-original quality)
📦 Full Quantization Options
| Download |  | Basic quantization |
| Download |  | Small size |
| Download |  | Balanced quality |
| Download |  | Better quality |
| Download |  | Fast on ARM |
| Download |  | Fast, recommended |
| Download |  ⭐ | Best balance |
| Download |  | Good quality |
| Download |  | Balanced |
| Download |  | High quality |
| Download |  🏆 | Very good quality |
| Download |  ⚡ | Fast, best quality |
| Download |  | Maximum accuracy |
💡 Tip: Use F16 for maximum precision when quality is critical