CoolFace
Modelpublic

JoaoBoer/tofu_Llama-3.2-3B-Instruct_forget01_IdkDPO

sourceHugging Facellama3.2updated 17d agoView on Hugging Face
0likes57downloads
Model Card

tofuLlama-3.2-3B-Instructforget01_IdkDPO

open-unlearning/tofu_Llama-3.2-3B-Instruct_full unlearned on the TOFU forget01 split with IdkDPO, trained with the open-unlearning framework. Used as a weight-unlearning baseline / draft model in the Speculative-Decoding-Unlearning project.

Full training config: .hydra/config.yaml. TOFU evaluation outputs: evals/.

Method hyperparameters

yaml
gamma: 1.0
alpha: 2
retain_loss_type: NLL
beta: 0.05

TOFU summary metrics

metricvalue
exact_memorization0.9533
extraction_strength0.6091
forgetQAPARAProb0.1546
forgetQA_gibberish0.9035
forget_quality0.0143
forgettruthratio0.5402
mia_loss0.9987
miamink0.9994
miaminkplusplus0.9944
mia_zlib1.0000
model_utility0.6565
privleak-99.8588