CoolFace
Modelpublic

RichardErkhov/Weyaxi_-_OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch-gguf

sourceHugging Faceupdated 2y agoView on Hugging Face
0likes638downloads
Model Card

Quantization made by Richard Erkhov.

Github

Discord

Request more models

OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch - GGUF

  • —Model creator: https://huggingface.co/Weyaxi/
  • —Original model: https://huggingface.co/Weyaxi/OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch/
NameQuant methodSize
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.Q2_K.ggufQ2_K4.52GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.IQ3_XS.ggufIQ3_XS4.99GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.IQ3_S.ggufIQ3_S5.27GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.Q3_K_S.ggufQ3KS5.27GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.IQ3_M.ggufIQ3_M5.57GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.Q3_K.ggufQ3_K5.9GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.Q3_K_M.ggufQ3KM5.9GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.Q3_K_L.ggufQ3KL6.45GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.IQ4_XS.ggufIQ4_XS6.54GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.Q4_0.ggufQ4_06.86GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.IQ4_NL.ggufIQ4_NL6.9GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.Q4_K_S.ggufQ4KS6.91GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.Q4_K.ggufQ4_K7.33GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.Q4_K_M.ggufQ4KM7.33GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.Q4_1.ggufQ4_17.61GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.Q5_0.ggufQ5_08.36GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.Q5_K_S.ggufQ5KS8.36GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.Q5_K.ggufQ5_K8.6GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.Q5_K_M.ggufQ5KM8.6GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.Q5_1.ggufQ5_19.1GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.Q6_K.ggufQ6_K9.95GB
OpenOrcaPlatypus2-Platypus2-13B-QLora-0.80-epoch.Q8_0.ggufQ8_012.88GB

Original model description: <a href="https://www.buymeacoffee.com/PulsarAI" target="_blank"><img src="https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png" alt="Buy Me A Coffee" style="height: 60px !important;width: 217px !important;" ></a>

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

MetricValue
Avg.49.71
ARC (25-shot)59.81
HellaSwag (10-shot)82.69
MMLU (5-shot)56.96
TruthfulQA (0-shot)52.92
Winogrande (5-shot)74.43
GSM8K (5-shot)2.35
DROP (3-shot)18.83