CoolFace
Modelpublic

R136a1/InfinityKuno-2x7B

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
3likes76downloads
Model Card

InfinityKuno-2x7B

InfinityKuno-2x7B

Experimental model from Endevor/InfinityRP-v1-7B and SanjiWatsuki/Kunoichi-DPO-v2-7B models. Merged to MoE model with 2x7B parameters.

Prompt format:

Alpaca, Extended Alpaca, Roleplay-Alpaca. (Use any Alpaca based prompt formatting and you should be fine.)

Switch: FP16 - GGUF

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

MetricValue
Avg.72.32
AI2 Reasoning Challenge (25-Shot)69.62
HellaSwag (10-Shot)87.44
MMLU (5-Shot)64.49
TruthfulQA (0-shot)63.28
Winogrande (5-shot)82.72
GSM8k (5-shot)66.34