CoolFace
Modelpublic

JoaoBoer/tofu_Llama-3.2-1B-Instruct_forget01_IdkDPO

sourceHugging Facellama3.2updated 17d agoView on Hugging Face
0likes83downloads
Model Card

tofuLlama-3.2-1B-Instructforget01_IdkDPO

open-unlearning/tofu_Llama-3.2-1B-Instruct_full unlearned on the TOFU forget01 split with IdkDPO, trained with the open-unlearning framework. Used as a weight-unlearning baseline / draft model in the Speculative-Decoding-Unlearning project.

Full training config: .hydra/config.yaml. TOFU evaluation outputs: evals/.

Method hyperparameters

yaml
gamma: 1.0
alpha: 2
retain_loss_type: NLL
beta: 0.05

TOFU summary metrics

metricvalue
exact_memorization0.9119
extraction_strength0.3318
forgetQAPARAProb0.1571
forgetQA_gibberish0.9245
forget_quality0.0068
forgettruthratio0.5330
mia_loss0.9853
miamink0.9919
miaminkplusplus0.9888
mia_zlib0.9962
model_utility0.5716
privleak-98.4652