Modelpublic

LoSboccacc/orthogonal-2x7B-base

sourceHugging Faceupdated 3y agoView on Hugging Face

0likes75downloads

Model Card

basemodel: mistralai/Mistral-7B-Instruct-v0.2 gatemode: hidden # one of "hidden", "cheap_embed", or "random" dtype: bfloat16 # output dtype (float32, float16, or bfloat16) experts:

—sourcemodel: SanjiWatsuki/Silicon-Maid-7B positiveprompts:
—"roleplay"
—sourcemodel: mistralai/Mistral-7B-Instruct-v0.2 positiveprompts:
—"chat"

chatml format

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	68.13
AI2 Reasoning Challenge (25-Shot)	66.89
HellaSwag (10-Shot)	85.54
MMLU (5-Shot)	62.49
TruthfulQA (0-shot)	66.00
Winogrande (5-shot)	77.03
GSM8k (5-shot)	50.80