copenlu/dynamicqa

DYNAMICQA This is a repository for the paper DYNAMICQA: Tracing Internal Knowledge Conflicts in Language Models accepted at Findings of EMNLP 2024. Our paper investigates the Language Model's behaviour when the conflicting knowledge exist within the LM's parameters. We present a novel dataset containing inherently conflicting data, DYNAMICQA. Our dataset consists of three partitions, Static, Disputable 🤷‍♀️, and Temporal 🕰️. We also evaluate several measures on their… See the full description on the dataset page: https://huggingface.co/datasets/copenlu/dynamicqa.