Modelpublic

shirasko/llama-3.1-8b-instruct-crisp-golf

sourceHugging Faceupdated 2mo agoView on Hugging Face

0likes9downloads

Model Card

Unlearned Checkpoint

Selected hyperparameters (from unlearned_checkpoints.json):

Headline scores used for checkpoint selection:

From evaluation/score_comparison.csv:

Metric	Baseline (train)	After unlearn (train)	Baseline (test)	After unlearn (test)
QA accuracy	0.84	0.32	0.88	0.32
QA fraction	1	0.119	1	0.111
SimDom accuracy	0.92	0.7	0.9	0.82
SimDom fraction	1	0.672	1	0.877
MMLU accuracy	0.62	0.6	0.65	0.632
MMLU fraction	1	0.946	1	0.955

File	Description
`unlearned_checkpoints.json`	Checkpoint metadata & hyperparameters
`evaluation/evaluation_summary.json`	Full evaluation payload (train/test/relearning)
`evaluation/score_comparison.csv`	Baseline vs. unlearned comparison table