Modelpublic

Weyaxi/Nous-Hermes-2-SUS-Chat-34B-Linear

sourceHugging Faceotherupdated 3y agoView on Hugging Face

1likes68downloads

Model Card

image/png

Nous-Hermes-2-SUS-Chat-34B-Linear

This is the model for Nous-Hermes-2-SUS-Chat-34B-Linear. I used mergekit to merge models.

Yaml Config

yaml


models:
  - model: Nous-Hermes-2-Yi-34B
    parameters:
      weight: 0.5
  - model: SUS-Chat-34B
    parameters:
      weight: 0.3
merge_method: linear
dtype: bfloat16

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric	Value
Avg.	73.69
AI2 Reasoning Challenge (25-Shot)	66.38
HellaSwag (10-Shot)	84.94
MMLU (5-Shot)	76.82
TruthfulQA (0-shot)	59.19
Winogrande (5-shot)	82.79
GSM8k (5-shot)	72.02