CoolFace
Modelpublic

afrideva/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-V2-GGUF

sourceHugging Faceupdated 3y agoView on Hugging Face
1likes702downloads
Model Card

habanoz/TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-V2-GGUF

Quantized GGUF model files for TinyLlama-1.1B-intermediate-step-715k-1.5T-airoboros-3.1-V2 from habanoz

NameQuant methodSize
tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-v2.q2_k.ggufq2_k482.14 MB
tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-v2.q3_k_m.ggufq3km549.85 MB
tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-v2.q4_k_m.ggufq4km667.81 MB
tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-v2.q5_k_m.ggufq5km782.04 MB
tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-v2.q6_k.ggufq6_k903.41 MB
tinyllama-1.1b-intermediate-step-715k-1.5t-airoboros-3.1-v2.q8_0.ggufq8_01.17 GB

Original Model Card: