CoolFace
Modelpublic

OEvortex/vortex-3b

sourceHugging Faceotherupdated 2y agoView on Hugging Face
5likes98downloads
Model Card

[image] Model Overview

vortex-3b is a 2.78 billion parameter causal language model created by OEvortex that is derived from EleutherAI's Pythia-2.8b and fine-tuned on Vortex-50k dataset'

python
from transformers import pipeline

# Initialize the pipeline
pipe = pipeline("text-generation", model="OEvortex/vortex-3b")

# Use the pipeline
text = "Once upon a time"
generated_text = pipe(text, max_length=100, do_sample=True)[0]['generated_text']

print(generated_text)

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metricvortex 3bvortex 3b-v2dolly-v2-3bpythia-2.8b-deduped
Avg.35.7637.4625.2636.72
AI2 Reasoning Challenge (25-Shot)31.9139.6822.8336.26
HellaSwag (10-Shot)56.8965.0426.5560.66
MMLU (5-Shot)27.3225.0924.726.78
TruthfulQA (0-shot)37.3933.80035.56
Winogrande (5-shot)60.1459.1259.4360.22
GSM8k (5-shot)0.912.051.860.83