CoolFace
Modelpublic

afrideva/phi2-oasst-guanaco-bf16-custom-GGUF

sourceHugging Facemitupdated 3y agoView on Hugging Face
0likes105downloads
Model Card

anilbhatt1/phi2-oasst-guanaco-bf16-custom-GGUF

Quantized GGUF model files for phi2-oasst-guanaco-bf16-custom from anilbhatt1

NameQuant methodSize
phi2-oasst-guanaco-bf16-custom.fp16.gguffp165.56 GB
phi2-oasst-guanaco-bf16-custom.q2_k.ggufq2_k1.17 GB
phi2-oasst-guanaco-bf16-custom.q3_k_m.ggufq3km1.48 GB
phi2-oasst-guanaco-bf16-custom.q4_k_m.ggufq4km1.79 GB
phi2-oasst-guanaco-bf16-custom.q5_k_m.ggufq5km2.07 GB
phi2-oasst-guanaco-bf16-custom.q6_k.ggufq6_k2.29 GB
phi2-oasst-guanaco-bf16-custom.q8_0.ggufq8_02.96 GB

Original Model Card:

Finetuned microsoft-phi2 model

  • —microsoft-phi2 model finetuned on "timdettmers/openassistant-guanaco" dataset with qlora technique
  • —Will run on a colab T4 gpu