CoolFace
Modelpublic

RichardErkhov/Laksh-Jain_-_bloom-3b-detox-qlora-gguf

sourceHugging Faceupdated 1y agoView on Hugging Face
0likes744downloads
Model Card

Quantization made by Richard Erkhov.

Github

Discord

Request more models

bloom-3b-detox-qlora - GGUF

  • —Model creator: https://huggingface.co/Laksh-Jain/
  • —Original model: https://huggingface.co/Laksh-Jain/bloom-3b-detox-qlora/
NameQuant methodSize
bloom-3b-detox-qlora.Q2_K.ggufQ2_K1.52GB
bloom-3b-detox-qlora.IQ3_XS.ggufIQ3_XS1.68GB
bloom-3b-detox-qlora.IQ3_S.ggufIQ3_S1.71GB
bloom-3b-detox-qlora.Q3_K_S.ggufQ3KS1.71GB
bloom-3b-detox-qlora.IQ3_M.ggufIQ3_M1.81GB
bloom-3b-detox-qlora.Q3_K.ggufQ3_K1.9GB
bloom-3b-detox-qlora.Q3_K_M.ggufQ3KM1.9GB
bloom-3b-detox-qlora.Q3_K_L.ggufQ3KL2.02GB
bloom-3b-detox-qlora.IQ4_XS.ggufIQ4_XS2.0GB
bloom-3b-detox-qlora.Q4_0.ggufQ4_02.08GB
bloom-3b-detox-qlora.IQ4_NL.ggufIQ4_NL2.09GB
bloom-3b-detox-qlora.Q4_K_S.ggufQ4KS2.09GB
bloom-3b-detox-qlora.Q4_K.ggufQ4_K2.24GB
bloom-3b-detox-qlora.Q4_K_M.ggufQ4KM2.24GB
bloom-3b-detox-qlora.Q4_1.ggufQ4_12.25GB
bloom-3b-detox-qlora.Q5_0.ggufQ5_02.43GB
bloom-3b-detox-qlora.Q5_K_S.ggufQ5KS2.43GB
bloom-3b-detox-qlora.Q5_K.ggufQ5_K2.55GB
bloom-3b-detox-qlora.Q5_K_M.ggufQ5KM2.55GB
bloom-3b-detox-qlora.Q5_1.ggufQ5_12.6GB
bloom-3b-detox-qlora.Q6_K.ggufQ6_K2.8GB
bloom-3b-detox-qlora.Q8_0.ggufQ8_03.62GB

Original model description: --- pipeline_tag: text-generation tags:

  • —text-generation
  • —transformers
  • —peft
  • —qlora ---