Rosariou/quiz_knowledge_consistency_in_LLMs

For background on this dataset, please check https://arxiv.org/abs/2405.20163. What it is: Each dataset in this delivery is made up of query clusters that test an aspect of the consistency of the LLM knowledge about a particular domain. All the questions in each cluster are meant to be answered either 'yes' or 'no'. When the answers vary within a cluster, the knowledge is said to be inconsistent. When all the questions in a cluster are answered 'no' when the expected answer… See the full description on the dataset page: https://huggingface.co/datasets/Rosariou/quiz_knowledge_consistency_in_LLMs.