allenai/ai2_arc

1---2annotations_creators:3- found4language_creators:5- found6language:7- en8license:9- cc-by-sa-4.010multilinguality:11- monolingual12size_categories:13- 1K<n<10K14source_datasets:15- original16task_categories:17- question-answering18task_ids:19- open-domain-qa20- multiple-choice-qa21pretty_name: Ai2Arc22language_bcp47:23- en-US24dataset_info:25- config_name: ARC-Challenge26  features:27  - name: id28    dtype: string29  - name: question30    dtype: string31  - name: choices32    sequence:33    - name: text34      dtype: string35    - name: label36      dtype: string37  - name: answerKey38    dtype: string39  splits:40  - name: train41    num_bytes: 34976042    num_examples: 111943  - name: test44    num_bytes: 37551145    num_examples: 117246  - name: validation47    num_bytes: 9666048    num_examples: 29949  download_size: 44946050  dataset_size: 82193151- config_name: ARC-Easy52  features:53  - name: id54    dtype: string55  - name: question56    dtype: string57  - name: choices58    sequence:59    - name: text60      dtype: string61    - name: label62      dtype: string63  - name: answerKey64    dtype: string65  splits:66  - name: train67    num_bytes: 61900068    num_examples: 225169  - name: test70    num_bytes: 65751471    num_examples: 237672  - name: validation73    num_bytes: 15739474    num_examples: 57075  download_size: 76293576  dataset_size: 143390877configs:78- config_name: ARC-Challenge79  data_files:80  - split: train81    path: ARC-Challenge/train-*82  - split: test83    path: ARC-Challenge/test-*84  - split: validation85    path: ARC-Challenge/validation-*86- config_name: ARC-Easy87  data_files:88  - split: train89    path: ARC-Easy/train-*90  - split: test91    path: ARC-Easy/test-*92  - split: validation93    path: ARC-Easy/validation-*94---95 96# Dataset Card for "ai2_arc"97 98## Table of Contents99- [Dataset Description](#dataset-description)100  - [Dataset Summary](#dataset-summary)101  - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)102  - [Languages](#languages)103- [Dataset Structure](#dataset-structure)104  - [Data Instances](#data-instances)105  - [Data Fields](#data-fields)106  - [Data Splits](#data-splits)107- [Dataset Creation](#dataset-creation)108  - [Curation Rationale](#curation-rationale)109  - [Source Data](#source-data)110  - [Annotations](#annotations)111  - [Personal and Sensitive Information](#personal-and-sensitive-information)112- [Considerations for Using the Data](#considerations-for-using-the-data)113  - [Social Impact of Dataset](#social-impact-of-dataset)114  - [Discussion of Biases](#discussion-of-biases)115  - [Other Known Limitations](#other-known-limitations)116- [Additional Information](#additional-information)117  - [Dataset Curators](#dataset-curators)118  - [Licensing Information](#licensing-information)119  - [Citation Information](#citation-information)120  - [Contributions](#contributions)121 122## Dataset Description123 124- **Homepage:** [https://allenai.org/data/arc](https://allenai.org/data/arc)125- **Repository:** [More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)126- **Paper:** [Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge](https://arxiv.org/abs/1803.05457)127- **Point of Contact:** [More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)128- **Size of downloaded dataset files:** 1361.68 MB129- **Size of the generated dataset:** 2.28 MB130- **Total amount of disk used:** 1363.96 MB131 132### Dataset Summary133 134A new dataset of 7,787 genuine grade-school level, multiple-choice science questions, assembled to encourage research in135 advanced question-answering. The dataset is partitioned into a Challenge Set and an Easy Set, where the former contains136 only questions answered incorrectly by both a retrieval-based algorithm and a word co-occurrence algorithm. We are also137 including a corpus of over 14 million science sentences relevant to the task, and an implementation of three neural baseline models for this dataset. We pose ARC as a challenge to the community.138 139### Supported Tasks and Leaderboards140 141[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)142 143### Languages144 145[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)146 147## Dataset Structure148 149### Data Instances150 151#### ARC-Challenge152 153- **Size of downloaded dataset files:** 680.84 MB154- **Size of the generated dataset:** 0.83 MB155- **Total amount of disk used:** 681.67 MB156 157An example of 'train' looks as follows.158```159{160    "answerKey": "B",161    "choices": {162        "label": ["A", "B", "C", "D"],163        "text": ["Shady areas increased.", "Food sources increased.", "Oxygen levels increased.", "Available water increased."]164    },165    "id": "Mercury_SC_405487",166    "question": "One year, the oak trees in a park began producing more acorns than usual. The next year, the population of chipmunks in the park also increased. Which best explains why there were more chipmunks the next year?"167}168```169 170#### ARC-Easy171 172- **Size of downloaded dataset files:** 680.84 MB173- **Size of the generated dataset:** 1.45 MB174- **Total amount of disk used:** 682.29 MB175 176An example of 'train' looks as follows.177```178{179    "answerKey": "B",180    "choices": {181        "label": ["A", "B", "C", "D"],182        "text": ["Shady areas increased.", "Food sources increased.", "Oxygen levels increased.", "Available water increased."]183    },184    "id": "Mercury_SC_405487",185    "question": "One year, the oak trees in a park began producing more acorns than usual. The next year, the population of chipmunks in the park also increased. Which best explains why there were more chipmunks the next year?"186}187```188 189### Data Fields190 191The data fields are the same among all splits.192 193#### ARC-Challenge194- `id`: a `string` feature.195- `question`: a `string` feature.196- `choices`: a dictionary feature containing:197  - `text`: a `string` feature.198  - `label`: a `string` feature.199- `answerKey`: a `string` feature.200 201#### ARC-Easy202- `id`: a `string` feature.203- `question`: a `string` feature.204- `choices`: a dictionary feature containing:205  - `text`: a `string` feature.206  - `label`: a `string` feature.207- `answerKey`: a `string` feature.208 209### Data Splits210 211|    name     |train|validation|test|212|-------------|----:|---------:|---:|213|ARC-Challenge| 1119|       299|1172|214|ARC-Easy     | 2251|       570|2376|215 216## Dataset Creation217 218### Curation Rationale219 220[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)221 222### Source Data223 224#### Initial Data Collection and Normalization225 226[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)227 228#### Who are the source language producers?229 230[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)231 232### Annotations233 234#### Annotation process235 236[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)237 238#### Who are the annotators?239 240[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)241 242### Personal and Sensitive Information243 244[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)245 246## Considerations for Using the Data247 248### Social Impact of Dataset249 250[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)251 252### Discussion of Biases253 254[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)255 256### Other Known Limitations257 258[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)259 260## Additional Information261 262### Dataset Curators263 264[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)265 266### Licensing Information267 268[More Information Needed](https://github.com/huggingface/datasets/blob/master/CONTRIBUTING.md#how-to-contribute-to-the-dataset-cards)269 270### Citation Information271 272```273@article{allenai:arc,274      author    = {Peter Clark  and Isaac Cowhey and Oren Etzioni and Tushar Khot and275                    Ashish Sabharwal and Carissa Schoenick and Oyvind Tafjord},276      title     = {Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challenge},277      journal   = {arXiv:1803.05457v1},278      year      = {2018},279}280 281```282 283 284### Contributions285 286Thanks to [@lewtun](https://github.com/lewtun), [@patrickvonplaten](https://github.com/patrickvonplaten), [@thomwolf](https://github.com/thomwolf) for adding this dataset.