CoolFace
Modelpublic

RichardErkhov/cloudyu_-_Mixtral_7Bx5_MoE_30B_DPO-gguf

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes802downloads
Model Card

Quantization made by Richard Erkhov.

Github

Discord

Request more models

Mixtral7Bx5MoE30BDPO - GGUF

  • —Model creator: https://huggingface.co/cloudyu/
  • —Original model: https://huggingface.co/cloudyu/Mixtral7Bx5MoE30BDPO/
NameQuant methodSize
Mixtral_7Bx5_MoE_30B_DPO.Q2_K.ggufQ2_K10.14GB
Mixtral_7Bx5_MoE_30B_DPO.IQ3_XS.ggufIQ3_XS11.35GB
Mixtral_7Bx5_MoE_30B_DPO.IQ3_S.ggufIQ3_S11.99GB
Mixtral_7Bx5_MoE_30B_DPO.Q3_K_S.ggufQ3KS11.97GB
Mixtral_7Bx5_MoE_30B_DPO.IQ3_M.ggufIQ3_M12.2GB
Mixtral_7Bx5_MoE_30B_DPO.Q3_K.ggufQ3_K13.29GB
Mixtral_7Bx5_MoE_30B_DPO.Q3_K_M.ggufQ3KM13.29GB
Mixtral_7Bx5_MoE_30B_DPO.Q3_K_L.ggufQ3KL14.39GB
Mixtral_7Bx5_MoE_30B_DPO.IQ4_XS.ggufIQ4_XS14.97GB
Mixtral_7Bx5_MoE_30B_DPO.Q4_0.ggufQ4_015.64GB
Mixtral_7Bx5_MoE_30B_DPO.IQ4_NL.ggufIQ4_NL15.79GB
Mixtral_7Bx5_MoE_30B_DPO.Q4_K_S.ggufQ4KS15.78GB
Mixtral_7Bx5_MoE_30B_DPO.Q4_K.ggufQ4_K16.79GB
Mixtral_7Bx5_MoE_30B_DPO.Q4_K_M.ggufQ4KM16.79GB
Mixtral_7Bx5_MoE_30B_DPO.Q4_1.ggufQ4_117.37GB
Mixtral_7Bx5_MoE_30B_DPO.Q5_0.ggufQ5_019.09GB
Mixtral_7Bx5_MoE_30B_DPO.Q5_K_S.ggufQ5KS19.09GB
Mixtral_7Bx5_MoE_30B_DPO.Q5_K.ggufQ5_K19.68GB
Mixtral_7Bx5_MoE_30B_DPO.Q5_K_M.ggufQ5KM19.68GB
Mixtral_7Bx5_MoE_30B_DPO.Q5_1.ggufQ5_120.82GB
Mixtral_7Bx5_MoE_30B_DPO.Q6_K.ggufQ6_K22.76GB
Mixtral_7Bx5_MoE_30B_DPO.Q8_0.ggufQ8_029.48GB

Original model description: --- license: mit tags:

  • —moe
  • —metric not test