CoolFace
Modelpublic

JoaoBoer/tofu_Llama-3.2-3B-Instruct_forget10_WGA

sourceHugging Facellama3.2updated 17d agoView on Hugging Face
0likes212downloads
Model Card

tofuLlama-3.2-3B-Instructforget10_WGA

open-unlearning/tofu_Llama-3.2-3B-Instruct_full unlearned on the TOFU forget10 split with WGA, trained with the open-unlearning framework. Used as a weight-unlearning baseline / draft model in the Speculative-Decoding-Unlearning project.

Full training config: .hydra/config.yaml. TOFU evaluation outputs: evals/.

Method hyperparameters

yaml
gamma: 1.0
alpha: 1.0
retain_loss_type: NLL
beta: 1.0

TOFU summary metrics

metricvalue
exact_memorization0.0272
extraction_strength0.0325
forgetQAPARAProb0.0004
forgetQA_gibberish0.1701
forget_quality0.0000
forgettruthratio0.7766
mia_loss0.0037
miamink0.0077
miaminkplusplus0.9205
mia_zlib0.0003
model_utility0.6450
privleak63.7584