CoolFace
Modelpublic

sthenno-com/miscii-14b-1028

sourceHugging Faceapache-2.0updated 9mo agoView on Hugging Face
18likes55downloads
Model Card

miscii-14b-1028

Role-based Instructions

Just parse the following as your system prompt. Note there is NO special-tokens here.

An example system prompt:

python
system_prompt: str = (
    """<|context_start|>personas<|context_sep|>
<|persona_start|>user<|persona_sep|>
{user_persona}<|persona_end|>
<|persona_start|>assistant<|persona_sep|>
{assistant_persona}<|persona_end|><|context_end|>""".format(
        user_persona="""I am Miscii.
I am the designer of Sthenno.
[Optional: Additional statements]""",
        assistant_persona="""I am Sthenno.
I speak in Chinese.
[Optional: Additional statements]""",
    )
)

Training

See Report for miscii-1020 for more details.


Open LLM Leaderboard Evaluation Results (0215)

MetricValue
Avg.35.05
IFEval (0-Shot)82.37
BBH (3-Shot)49.26
MATH Lvl 5 (4-Shot)6.34
GPQA (0-shot)14.21
MuSR (0-shot)12.00
MMLU-PRO (5-shot)46.14

Open LLM Leaderboard Evaluation Results

Refined:

MetricValue
Avg.42.38
IFEval (0-Shot)82.37
BBH (3-Shot)49.26
MATH Lvl 5 (4-Shot)50.30
GPQA (0-shot)14.21
MuSR (0-shot)12.00
MMLU-PRO (5-shot)46.14

$$\large{\text{There's nothing more to Show}}$$