CoolFace
Modelpublic

duyntnet/Delexa-Instruct-V0.1-7b-imatrix-GGUF

sourceHugging Faceotherupdated 2y agoView on Hugging Face
0likes2.1kdownloads
Model Card

Quantizations of https://huggingface.co/lex-hue/Delexa-Instruct-V0.1-7b

From original readme

Delexa-V0.1-Instruct-7b: Our Newest and Best Model Yet!

We are excited to announce the release of Delexa-V0.1-Instruct-7b, our newest and best model yet! Delexa-V0.1-Instruct-7b has shown excellent performance on a variety of tasks, and we are confident that it will be a valuable asset to the research community.

Eval Results

Delexa-V0.1-Instruct-7b was evaluated on a dataset of question-answer pairs. The model was given a single question and three different answer choices, and it was tasked with selecting the best answer. Delexa-V0.1-Instruct-7b achieved an average score of 8.27 on this task.

Here is a table showing the detailed eval results:

ModelTurn 1Turn 2Average
gpt-48.956259.02508.990625
Delexa-V0.1-Instruct-7b8.575007.95008.268750
claude-v18.150007.65007.900000
gpt-3.5-turbo8.075007.81257.943750
vicuna-13b-v1.36.812505.96256.387500
palm-2-chat-bison-0016.712506.08756.400000