DataScienceUIBK/ComplexTempQA

1---2license: cc0-1.03task_categories:4- question-answering5language:6- en7size_categories:8- 100M<n<1B9---10# ComplexTempQA Dataset11 12ComplexTempQA is a large-scale dataset designed for complex temporal question answering (TQA). It consists of over 100 million question-answer pairs, making it one of the most extensive datasets available for TQA. The dataset is generated using data from Wikipedia and Wikidata and spans questions over a period of 36 years (1987-2023).13 14**Note:** We have a smaller version consisting of questions from the time period 1987 until 2007.15 16## Dataset Description17 18ComplexTempQA categorizes questions into three main types:19- Attribute Questions20- Comparison Questions21- Counting Questions22 23These categories are further divided based on their relation to events, entities, or time periods. 24 25### Question Types and Counts26 27| | Question Type         | Subtype             | Count         |28|--|-----------------------|---------------------|---------------|29|1a| Attribute             | Event               | 83,798        |30|1b| Attribute             | Entity              | 84,079        |31|1c| Attribute             | Time                | 9,454         |32|2a| Comparison            | Event               | 25,353,340    |33|2b| Comparison            | Entity              | 74,678,117    |34|2c| Comparison            | Time                | 54,022,952    |35|3a| Counting              | Event               | 18,325        |36|3b| Counting              | Entity              | 10,798        |37|3c| Counting              | Time                | 12,732        |38|  | Multi-Hop             |                     | 76,933        |39|  | Unnamed Event         |                     | 8,707,123     |40|  | **Total**             |                     | **100,228,457**|41 42### Metadata43 44- **id**: A unique identifier for each question.45- **question**: The text of the question being asked.46- **answer**: The answer(s) to the question.47- **type**: The type of question based on the dataset’s taxonomy.48- **rating**: A numerical rating indicating the difficulty of the question (`0` for easy, `1` for hard).49- **timeframe**: The start and end dates relevant to the question.50- **question_entity**: List of Wikidata IDs related to the entities in the question.51- **answer_entity**: List of Wikidata IDs related to the entities in the answer.52- **question_country**: List of Wikidata IDs of the countries associated with the questioned entities or events.53- **answer_country**: List of Wikidata IDs of the countries associated with the answered entities or events.54- **is_unnamed**: A flag indicating if the question contains an implicitly described event (`1` for yes, `0` for no).55 56 57 58## Dataset Characteristics59 60### Size61ComplexTempQA comprises over 100 million question-answer pairs, focusing on events, entities, and time periods from 1987 to 2023.62 63### Complexity64Questions require advanced reasoning skills, including multi-hop question answering, temporal aggregation, and across-time comparisons.65 66### Taxonomy67The dataset follows a unique taxonomy categorizing questions into attributes, comparisons, and counting types, ensuring comprehensive coverage of temporal queries.68 69### Evaluation70The dataset has been evaluated for readability, ease of answering before and after web searches, and overall clarity. Human raters have assessed a sample of questions to ensure high quality.71 72## Usage73 74### Evaluation and Training75ComplexTempQA can be used for:76- Evaluating the temporal reasoning capabilities of large language models (LLMs)77- Fine-tuning language models for better temporal understanding78- Developing and testing retrieval-augmented generation (RAG) systems79 80### Research Applications81The dataset supports research in:82- Temporal question answering83- Information retrieval84- Language understanding85 86### Adaptation and Continual Learning87ComplexTempQA's temporal metadata facilitates the development of online adaptation and continual training approaches for LLMs, aiding in the exploration of time-based learning and evaluation.88 89## Access90 91The dataset and code are freely available at [https://github.com/DataScienceUIBK/ComplexTempQA](https://github.com/DataScienceUIBK/ComplexTempQA).