CoolFace
Modelpublic

afrideva/tiny-llama-1.1b-chat-medical-GGUF

sourceHugging Faceupdated 3y agoView on Hugging Face
5likes456downloads
Model Card

SumayyaAli/tiny-llama-1.1b-chat-medical-GGUF

Quantized GGUF model files for tiny-llama-1.1b-chat-medical from SumayyaAli

NameQuant methodSize
tiny-llama-1.1b-chat-medical.fp16.gguffp162.20 GB
tiny-llama-1.1b-chat-medical.q2_k.ggufq2_k483.12 MB
tiny-llama-1.1b-chat-medical.q3_k_m.ggufq3km550.82 MB
tiny-llama-1.1b-chat-medical.q4_k_m.ggufq4km668.79 MB
tiny-llama-1.1b-chat-medical.q5_k_m.ggufq5km783.02 MB
tiny-llama-1.1b-chat-medical.q6_k.ggufq6_k904.39 MB
tiny-llama-1.1b-chat-medical.q8_0.ggufq8_01.17 GB

Original Model Card: