allenai/nq_open_mc
Natural Questions: a Benchmark for Question Answering Research https://storage.googleapis.com/pub-tools-public-publication-data/pdf/1f7b46b5378d757553d3e92ead36bda2e4254244.pdf The Natural Questions (NQ) corpus is a question-answering dataset that contains questions from real users and requires QA systems to read and comprehend an entire Wikipedia article that may or may not contain the answer to the question. The inclusion of real user questions, and the requirement that solutions should read… See the full description on the dataset page: https://huggingface.co/datasets/allenai/nq_open_mc.
Natural Questions: a Benchmark for Question Answering Research
https://storage.googleapis.com/pub-tools-public-publication-data/pdf/1f7b46b5378d757553d3e92ead36bda2e4254244.pdf
The Natural Questions (NQ) corpus is a question-answering dataset that contains questions from real users and requires QA systems to read and comprehend an entire Wikipedia article that may or may not contain the answer to the question. The inclusion of real user questions, and the requirement that solutions should read an entire page to find the answer, cause NQ to be a more realistic and challenging task than prior QA datasets.
We use the much smaller nq_open dataset that only focuses on the short answers
Homepage: https://ai.google.com/research/NaturalQuestions
NOTE: this is the reformulated multiple choice version of the Natural Questions task, with downsampling.