rongzhangibm/NaturalQuestionsV2
Dataset Card for Natural Questions Dataset Summary The NQ corpus contains questions from real users, and it requires QA systems to read and comprehend an entire Wikipedia article that may or may not contain the answer to the question. The inclusion of real user questions, and the requirement that solutions should read an entire page to find the answer, cause NQ to be a more realistic and challenging task than prior QA datasets. Supported Tasks and… See the full description on the dataset page: https://huggingface.co/datasets/rongzhangibm/NaturalQuestionsV2.
added README.md
added dataset_info.json
added script nq.py
added dataset_dict.json
added train dataset_info.json and state.json
added train dataset.arrow.15~19.gz
added train dataset.arrow.10~14.gz
added train dataset.arrow.05~09.gz
added train dataset.arrow.00~04.gz
added validation set
remove validation folder which has the wrong file names
delete files which were used for testing
add validation folder
dataset.arrow.00 for NQ validation
state.json for NQ validation set
dataset_info.json for NQ validation
initial commit
