CoolFace
Modelpublic

TomGrc/FusionNet_linear

sourceHugging Facemitupdated 3y agoView on Hugging Face
8likes72downloads
Model Card

FusionNet_linear

Fine-tuned model on English language using linear Fusion method.

Model description

This is an experiment with the linear Fusion method of FusionNet. This model has 10.7B parameters, and this model is fine-tuned. Enjoy!

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

MetricValue
Avg.74.43
AI2 Reasoning Challenge (25-Shot)71.25
HellaSwag (10-Shot)88.44
MMLU (5-Shot)66.35
TruthfulQA (0-shot)71.94
Winogrande (5-shot)83.27
GSM8k (5-shot)65.35