CoolFace
Modelpublic

beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B-Merged

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
5likes14downloads
Model Card

KoAlpaca-RealQA-Solar-Ko-Recovery-11B-Merged

LoRA merged model from beomi/KoAlpaca-RealQA-Solar-Ko-Recovery-11B

  • —Developed by: beomi
  • —License: apache-2.0
  • —Finetuned from model : beomi/Solar-Ko-Recovery-11B

Eval with LogicKor

Default

CategorySingle turnMulti turn
이해(Understanding)8.435.86
수학(Math)3.861.00
글쓰기(Writing)9.717.71
추론(Reasoning)7.573.86
코딩(Coding)7.577.00
문법(Grammar)7.434.14
CategoryScore
Single turn7.43
Multi turn4.93
Overall6.18

1-Shot

CategorySingle turnMulti turn
추론(Reasoning)7.574.43
코딩(Coding)7.298.57
수학(Math)2.861.71
글쓰기(Writing)9.297.57
이해(Understanding)7.435.86
문법(Grammar)7.294.71
CategoryScore
Single turn6.95
Multi turn5.48
Overall6.21

CoT-1-Shot

CategorySingle turnMulti turn
코딩(Coding)7.148.14
추론(Reasoning)6.863.57
글쓰기(Writing)9.717.71
수학(Math)2.291.14
이해(Understanding)7.437.00
문법(Grammar)7.293.14
CategoryScore
Single turn6.79
Multi turn5.12
Overall5.95

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>