CoolFace
Modelpublic

JoaoBoer/tofu_Llama-3.2-3B-Instruct_forget01_SimNPO

sourceHugging Facellama3.2updated 16d agoView on Hugging Face
0likes181downloads
Model Card

tofuLlama-3.2-3B-Instructforget01_SimNPO

open-unlearning/tofu_Llama-3.2-3B-Instruct_full unlearned on the TOFU forget01 split with SimNPO, trained with the open-unlearning framework. Used as a weight-unlearning baseline / draft model in the Speculative-Decoding-Unlearning project.

Full training config: .hydra/config.yaml. TOFU evaluation outputs: evals/.

Method hyperparameters

yaml
gamma: 0.125
alpha: 1
retain_loss_type: NLL
delta: 1
beta: 3.5

TOFU summary metrics

metricvalue
exact_memorization0.7596
extraction_strength0.1462
forgetQAPARAProb0.0612
forgetQA_gibberish0.9033
forget_quality0.1650
forgettruthratio0.5430
mia_loss0.8378
miamink0.8331
miaminkplusplus0.6225
mia_zlib0.7819
model_utility0.5663
privleak-62.2881