datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
boolq-natural-perturbationsBoolQ questions with semantic alteration and human verifications
@article{khashabi2020naturalperturbations,
title={Natural Perturbation for Robust Question Answering},
author={D. Khashabi and T. Khot and A. Sabhwaral},
journal={arXiv preprint},
year={2020}
}
TextToText_boolqboolq_with_dev_hpoBoolQ_robustness
Dataset Card for "BoolQ-robustness"
Dataset Summary
BoolQ-robustness is an expanded version of the BoolQ dataset (https://arxiv.org/abs/1905.10044) but with perturbations of the original input questions and passages.
It is intended for use as a benchmark for evaluating model robustness on question-answering to these perturbations.
Data Instances
boolq_robustness
Size of downloaded dataset file: 21.8 MB
Data Fields… See the full description on the dataset page: https://huggingface.co/datasets/ibm-research/BoolQ_robustness.boolq-mk
BoolQ MK version
This dataset is a Macedonian adaptation of the BoolQ dataset, originally curated (English -> Serbian) by Aleksa Gordić. It was translated from Serbian to Macedonian using the Google Translate API.
You can find this dataset as part of the macedonian-llm-eval GitHub and HuggingFace.
The dataset can be used to evaluate the models described in the paper Towards Open Foundation Language Model and Corpus for Macedonian: A Low-Resource Language.
Why Translate from… See the full description on the dataset page: https://huggingface.co/datasets/LVSTCK/boolq-mk.llama2_7b_chat-boolq
Dataset Card for "llama2_7b_chat-boolq"
More Information needed
shuffle_boolqllm-metric-super_glue-boolqesperanto-boolq-questions
esperanto-boolq-questions
BoolQ questions (train + validation, 12,697 rows) translated from
English to Esperanto by
jensjepsen/eo-mt-v13-large-bidir,
with round-trip quality metadata for filtering.
Row schema
field
description
orig_idx
original BoolQ row index (train first, then validation)
split
source split (train / validation)
en_orig
raw BoolQ question (lowercase, no ?, as in google/boolq)
en_preproc
preprocessed input fed to MT: spaCy… See the full description on the dataset page: https://huggingface.co/datasets/jensjepsen/esperanto-boolq-questions.boolq-trainboolq-deepl-translated-sft
Dataset Card for Finnish-NLP/boolq-deepl-translated-sft
Creation process
Load data from google/boolq translated with deepl
Write rows to .txt file with *** on a newline separating instruction/response and then END on a newline separating samples
Upload file to deepl.com for file translation --> parse samples back from translated files --> Maybe some additional cleaning/filtering based on fasttext langdetect / kenlm perplexity
forgetting-contamination-boolqThis dataset is a deduplicated subset of the validation split of BoolQ, as used in the paper How Much Can We Forget about Data Contamination?. The deduplication was performed using this script.
The data fields are the same as in https://huggingface.co/datasets/google/boolq, with the additional "split-id" column that can be used to partition the benchmark questions into different subsets.
The dataset can be used as a plug-in replacement for BoolQ if you want to work with the deduplicated… See the full description on the dataset page: https://huggingface.co/datasets/sbordt/forgetting-contamination-boolq.boolq-Llama-2-7b-hfboolq-Mistral-7B-Instruct-v0.2boolq_testingboolq-Mistral-7B-v0.1