CoolFace
Modelpublic

titan087/OpenLlama13B-Guanaco

sourceHugging Faceupdated 1y agoView on Hugging Face
1likes68downloads
Model Card

Open Llama 13b Finetuned using Qlora on the Guanaco dataset


datasets:

  • —timdettmers/openassistant-guanaco ---

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

MetricValue
Avg.41.32
ARC (25-shot)51.19
HellaSwag (10-shot)75.24
MMLU (5-shot)43.76
TruthfulQA (0-shot)38.4
Winogrande (5-shot)71.74
GSM8K (5-shot)2.96
DROP (3-shot)5.96