CoolFace
Modelpublic

afrideva/mpt-3b-8k-instruct-GGUF

sourceHugging Faceupdated 3y agoView on Hugging Face
2likes963downloads
Model Card

niallturbitt/mpt-3b-8k-instruct-GGUF

Quantized GGUF model files for mpt-3b-8k-instruct from niallturbitt

NameQuant methodSize
mpt-3b-8k-instruct.q2_k.ggufq2_k1.54 GB
mpt-3b-8k-instruct.q3_k_m.ggufq3km1.95 GB
mpt-3b-8k-instruct.q4_k_m.ggufq4km2.34 GB
mpt-3b-8k-instruct.q5_k_m.ggufq5km2.71 GB
mpt-3b-8k-instruct.q6_k.ggufq6_k2.98 GB
mpt-3b-8k-instruct.q8_0.ggufq8_03.86 GB

Original Model Card: