CoolFace
Modelpublic

JoaoBoer/tofu_Llama-3.2-3B-Instruct_forget01_NPO

sourceHugging Facellama3.2updated 17d agoView on Hugging Face
0likes60downloads
Model Card

tofuLlama-3.2-3B-Instructforget01_NPO

open-unlearning/tofu_Llama-3.2-3B-Instruct_full unlearned on the TOFU forget01 split with NPO, trained with the open-unlearning framework. Used as a weight-unlearning baseline / draft model in the Speculative-Decoding-Unlearning project.

Full training config: .hydra/config.yaml. TOFU evaluation outputs: evals/.

Method hyperparameters

yaml
gamma: 1.0
alpha: 2
retain_loss_type: NLL
beta: 0.1

TOFU summary metrics

metricvalue
exact_memorization0.6290
extraction_strength0.0765
forgetQAPARAProb0.0747
forgetQA_gibberish0.9057
forget_quality0.9188
forgettruthratio0.6576
mia_loss0.3563
miamink0.3169
miaminkplusplus0.3181
mia_zlib0.3600
model_utility0.6315
privleak54.3785