CoolFace
Modelpublic

MoonRide/Llama-3.2-3B-Khelavaster-GGUF

sourceHugging Facellama3.2updated 2y agoView on Hugging Face
1likes216downloads
Model Card

<img src="https://huggingface.co/MoonRide/Llama-3.2-3B-Khelavaster/resolve/main/Khelavaster.jpg">

Experimental merge of multiple Llama 3.2 3B models, guided by MoonRide-Index-v7. Created with mergekit.

Original model: MoonRide/Llama-3.2-3B-Khelavaster.

GGUFs made with llama.cpp (b4855). Calibration file used for creating imatrix: calibration_datav3.txt.

For best quality use Q80 or Q6K quant.