CoolFace
Modelpublic

Jiayi-Pan/Tiny-Vicuna-1B

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
16likes1.7kdownloads
Model Card

Tiny Vicuna 1B

This model is a fine-tuned version of TinyLlama on WizardVicuna Dataset. It should be fully compatible with Vicuna-v1.5 series.

This model is easy to iterate on for early experiments!

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

MetricValue
Avg.34.76
AI2 Reasoning Challenge (25-Shot)33.45
HellaSwag (10-Shot)55.92
MMLU (5-Shot)25.45
TruthfulQA (0-shot)33.82
Winogrande (5-shot)58.41
GSM8k (5-shot)1.52