CoolFace
Modelpublic

Locutusque/llama-3-neural-chat-v2.2-8B

sourceHugging Faceotherupdated 2y agoView on Hugging Face
16likes37downloads
Model Card

llama-3-neural-chat-v2.2-8b

<!-- Provide a quick summary of what the model is/does. -->

image/png

Model Details

Model Description

<!-- Provide a longer summary of what this model is. -->

I fine-tuned llama-3 8B on an approach similar to Intel's neural chat language model. I have slightly modified the data sources so it is stronger in coding, math, and writing. I use both SFT and DPO-Positive. DPO-Positive dramatically improves performance over DPO.

  • —Developed by: Locutusque
  • —Model type: Built with Meta Llama 3
  • —Language(s) (NLP): Many?
  • —License: Llama 3 license https://huggingface.co/meta-llama/Meta-Llama-3-8B/blob/main/LICENSE

Quants

GGUF: https://huggingface.co/bartowski/llama-3-neural-chat-v2.2-8B-GGUF

ExLlamaV2: https://huggingface.co/bartowski/llama-3-neural-chat-v2.2-8B-exl2

Uses

<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->

This model has great performance in writing, coding, and math.

Training Data

Recipe information will be coming soon. This language model's recipe is similar to Intel's Neural Chat.

Direct Use

<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->

Conversational AI. This model is also very uncensored, it will respond to pretty much any request regardless of the system prompt, use at your own risk.

Evaluations

TasksVersionFiltern-shotMetricValueStderr
truthfulqa_mc22none0acc0.5232±0.0151
gsm8k3strict-match5exact_match0.5974±0.0135
flexible-extract5exact_match0.5974±0.0135
agieval_nousN/Anone0acc_norm0.3841±0.0094
none0acc0.3802±0.0094
- agievalaquarat1none0acc0.2598±0.0276
none0acc_norm0.2520±0.0273
- agievallogiqaen1none0acc0.3441±0.0186
none0acc_norm0.3687±0.0189
- agievallsatar1none0acc0.2217±0.0275
none0acc_norm0.2348±0.0280
- agievallsatlr1none0acc0.3882±0.0216
none0acc_norm0.3824±0.0215
- agievallsatrc1none0acc0.4944±0.0305
none0acc_norm0.5019±0.0305
- agievalsaten1none0acc0.6650±0.0330
none0acc_norm0.6553±0.0332
- agievalsatenwithoutpassage1none0acc0.3981±0.0342
none0acc_norm0.3981±0.0342
- agievalsatmath1none0acc0.3500±0.0322
none0acc_norm0.3318±0.0318