Modelpublic

shirasko/gemma-2-2b-it-rmu-gambling

sourceHugging Faceupdated 2mo agoView on Hugging Face

0likes21downloads

Model Card

Unlearned Checkpoint

Selected hyperparameters (from unlearned_checkpoints.json):

Headline scores used for checkpoint selection:

From evaluation/score_comparison.csv:

Metric	Baseline (train)	After unlearn (train)	Baseline (test)	After unlearn (test)
QA accuracy	0.76	0.3	0.82	0.58
QA fraction	1	0.098	1	0.579
SimDom accuracy	0.94	0.98	0.96	0.94
SimDom fraction	1	1	1	0.972
MMLU accuracy	0.52	0.52	0.551	0.528
MMLU fraction	1	1	1	0.924

File	Description
`unlearned_checkpoints.json`	Checkpoint metadata & hyperparameters
`evaluation/evaluation_summary.json`	Full evaluation payload (train/test/relearning)
`evaluation/score_comparison.csv`	Baseline vs. unlearned comparison table