RichardErkhov/dddsaty_-_KoSOLAR-10.7B_DPO_Adapter_Attach-gguf

Quantization made by Richard Erkhov.

Github

Discord

Request more models

KoSOLAR-10.7BDPOAdapter_Attach - GGUF

• —Model creator: https://huggingface.co/dddsaty/
• —Original model: https://huggingface.co/dddsaty/KoSOLAR-10.7BDPOAdapter_Attach/

Original model description: --- license: apache-2.0 datasets: We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs language:

• —ko pipeline_tag: text-generation ---

Explanation

• —With the base model, applied DPO to the small amount of layers with the open dataset , saved the adapter part
• —Attached the base model and the tuned adapter together

Base Model

• —yanolja/KoSOLAR-10.7B-v0.3

Used Corpus

• —We-Want-GPU/Yi-Ko-DPO-Orca-DPO-Pairs

Score |Average|Ko-ARC|Ko-HellaSwag|Ko-MMLU|Ko-TruthfulQA|Ko-CommonGen V2| |:---:|:---:|:---:|:---:|:---:|:---:| |56.24|53.33|64.36|55.63|45.42|62.46|

Log

• —2024.02.13: Initial version Upload

LICENSE

• —Apache 2.0