concept-vectors
ConceptVectors
ConceptVectors
🚀The first-ever parametric LLM Unlearning Benchmark!
We find current unlearning methods only modify model’s behavior without truly erasing encoded knowledge in parameters. For this, we present ConceptVectors Benchmark, with each vector strongly tied to a specific concept.
The ConceptVectors Benchmark for the paper "Intrinsic Evaluation of Unlearning Using Parametric Knowledge Traces".
Links
Paper: Intrinsic Test of Unlearning Using Parametric Knowledge… See the full description on the dataset page: https://huggingface.co/datasets/YihuaiHong/ConceptVectors.spatial_concept_vectors