CoolFace
Modelpublic

camel-ai/CAMEL-13B-Role-Playing-Data

sourceHugging Faceupdated 2y agoView on Hugging Face
25likes182downloads
Model Card

CAMEL-13B-Role-Playing-Data is a chat large language model obtained by finetuning LLaMA-13B model on a total of 229K conversations created through our role-playing framework proposed in CAMEL. We evaluate our model offline using EleutherAI's language model evaluation harness used by Huggingface's Open LLM Benchmark. CAMEL-13B scores an average of 57.2. --- license: cc-by-nc-4.0 ---

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

MetricValue
Avg.45.03
ARC (25-shot)54.95
HellaSwag (10-shot)79.25
MMLU (5-shot)46.61
TruthfulQA (0-shot)46.35
Winogrande (5-shot)74.03
GSM8K (5-shot)7.35
DROP (3-shot)6.66