copenlu/dynamicqa

DYNAMICQA

This is a repository for the paper DYNAMICQA: Tracing Internal Knowledge Conflicts in Language Models accepted at Findings of EMNLP 2024.

<p align="center"> <img src="mainfigure.png" width="800" alt="mainfigure"> </p>

Our paper investigates the Language Model's behaviour when the conflicting knowledge exist within the LM's parameters. We present a novel dataset containing inherently conflicting data, DYNAMICQA. Our dataset consists of three partitions, Static, Disputable 🤷‍♀️, and Temporal 🕰️.

We also evaluate several measures on their ability to reflect the presence of intra-memory conflict: Semantic Entropy and a novel Coherent Persuasion Score. You can find our findings from our paper!

The implementation of the measures is available on our github repo!

Dataset

Our dataset consists of three different partitions.

Details

1. 1.Question : "question" column

1. 1.Answers : Two different answers are available: one in the "obj" column and the other in the "replace_name" column.

1. 1.Context : Context ("context" column) is masked with \[ENTITY\]. Before providing the context to the LM, you should replace \[ENTITY\] with either "obj" or "replace_name".

1. 1.Number of edits : "num_edits" column. This denotes Temporality for temporal partition, and Disputability for disputable partition.

Citation

If you find our dataset helpful, kindly refer to us in your work using the following citation:

@inproceedings{marjanović2024dynamicqatracinginternalknowledge,
      title={DYNAMICQA: Tracing Internal Knowledge Conflicts in Language Models}, 
      author={Sara Vera Marjanović and Haeun Yu and Pepa Atanasova and Maria Maistro and Christina Lioma and Isabelle Augenstein},
      year={2024},
      booktitle = {Findings of EMNLP},
      publisher = {Association for Computational Linguistics}
}