datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
fev_datasets
Forecast evaluation datasets
This repository contains time series datasets that can be used for evaluation of univariate & multivariate forecasting models.
The main focus of this repository is on datasets that reflect real-world forecasting scenarios, such as those involving covariates, missing values, and other practical complexities.
The datasets follow a format that is compatible with the fev package.
Data format and usage
Each dataset satisfies the following… See the full description on the dataset page: https://huggingface.co/datasets/autogluon/fev_datasets.nli_fever
Overview
The original dataset can be found here
while the Github repo is here.
This dataset has been proposed in Combining fact extraction and verification with neural semantic matching networks. This dataset has been created as a modification
of FEVER.
In the original FEVER setting, the input is a claim from Wikipedia and the expected output is a label.
However, this is different from the standard NLI formalization which is basically a pair-of-sequence to label problem.
To… See the full description on the dataset page: https://huggingface.co/datasets/pietrolesci/nli_fever.climate-fever-decontaminated
climate-fever (Decontaminated)
A decontaminated version of the climate-fever dataset from the BEIR benchmark, with samples found in the mgte-en pre-training dataset removed.
Decontamination methodology
Contamination was detected using a two-pass approach against the full mgte-en dataset (484 GB, 1,235 parquet files):
Pass 1: Exact hash matching
All texts (queries and corpus documents) were normalized (lowercased, unicode NFKD, whitespace collapsed) and hashed… See the full description on the dataset page: https://huggingface.co/datasets/lightonai/climate-fever-decontaminated.fever-decontaminated
fever (Decontaminated)
A decontaminated version of the fever dataset from the BEIR benchmark, with samples found in the mgte-en pre-training dataset removed.
Decontamination methodology
Contamination was detected using a two-pass approach against the full mgte-en dataset (484 GB, 1,235 parquet files):
Pass 1: Exact hash matching
All texts (queries and corpus documents) were normalized (lowercased, unicode NFKD, whitespace collapsed) and hashed with xxHash-64.… See the full description on the dataset page: https://huggingface.co/datasets/lightonai/fever-decontaminated.fever-qrels
Dataset Card for BEIR Benchmark
Dataset Summary
BEIR is a heterogeneous benchmark that has been built from 18 diverse datasets representing 9 information retrieval tasks:
Fact-checking: FEVER, Climate-FEVER, SciFact
Question-Answering: NQ, HotpotQA, FiQA-2018
Bio-Medical IR: TREC-COVID, BioASQ, NFCorpus
News Retrieval: TREC-NEWS, Robust04
Argument Retrieval: Touche-2020, ArguAna
Duplicate Question Retrieval: Quora, CqaDupstack
Citation-Prediction: SCIDOCS
Tweet… See the full description on the dataset page: https://huggingface.co/datasets/BeIR/fever-qrels.climate-fever-qrels
Dataset Card for BEIR Benchmark
Dataset Summary
BEIR is a heterogeneous benchmark that has been built from 18 diverse datasets representing 9 information retrieval tasks:
Fact-checking: FEVER, Climate-FEVER, SciFact
Question-Answering: NQ, HotpotQA, FiQA-2018
Bio-Medical IR: TREC-COVID, BioASQ, NFCorpus
News Retrieval: TREC-NEWS, Robust04
Argument Retrieval: Touche-2020, ArguAna
Duplicate Question Retrieval: Quora, CqaDupstack
Citation-Prediction: SCIDOCS
Tweet… See the full description on the dataset page: https://huggingface.co/datasets/BeIR/climate-fever-qrels.tl_ts_prompted_mergedPoly-FEVER
Poly-FEVER: A Multilingual Hallucination Detection Benchmark
Poly-FEVER is a controlled multilingual benchmark for factuality judgment and
hallucination detection. It extends FEVER, Climate-FEVER, and SciFact to 77,973
aligned claims in 11 languages. Each claim shares the same binary label across
languages and includes topic metadata from a 22-topic LDA model, allowing
language to vary while factual content and ground truth remain fixed.
Dataset overview… See the full description on the dataset page: https://huggingface.co/datasets/HanzhiZhang/Poly-FEVER.fever
Dataset Card for "fever"
FEVER dataset with evidence retrieved by KGAT, see my paper for more info.
Labels are converted to integers with the rule:
"SUPPORTS": 0
"NOT ENOUGH INFO": 1
"REFUTES": 2
turkish-over-refusal-set
turkish-over-refusal-set
from datasets import load_dataset
ds = load_dataset("fevziegeyurtsevenler/turkish-over-refusal-set")
An XSTest-style over-refusal evaluation for Turkish (+English): 120 matched pairs of a benign-but-scary prompt and a refuse-worthy twin sharing the same trigger word (popcorn patlat vs nose patlat; chord vur vs shoot vur; process kill/öldür vs person). 480 prompts, 10 categories.
Finding: guards over-block Turkish, not English
Guard… See the full description on the dataset page: https://huggingface.co/datasets/fevziegeyurtsevenler/turkish-over-refusal-set.feverous_3wayfever_3wayskills-in-the-wild
Skills in the Wild — Open Audit of AI Agent Extensions
from datasets import load_dataset
ds = load_dataset("fevziegeyurtsevenler/skills-in-the-wild")
The first open, reproducible audit of real agent extensions (Skills, MCP, rules files) on GitHub.
Schema
file
rows
columns
manifest.jsonl
3,168
repo, path, sha, surface, html_url
findings.jsonl
742
rule_id, severity, category, evidence
files.jsonl
3,168
n_findings, worst_severity, rule_ids… See the full description on the dataset page: https://huggingface.co/datasets/fevziegeyurtsevenler/skills-in-the-wild.fever_ftThe dataset contains a random 0.7/0.1/0.2 train/dev/test splits of fever dataset from BEIR https://github.com/beir-cellar/beir for benchmarking embedding model fine-tuning.
climate-fever-v2
ClimateFEVER.v2
An MTEB dataset
Massive Text Embedding Benchmark
CLIMATE-FEVER is a dataset following the FEVER methodology, containing 1,535 real-world climate change claims. This updated version addresses corpus mismatches and qrel inconsistencies in MTEB, restoring labels while refining corpus-query alignment for better accuracy.
Task category
t2t
Domains
Academic, Written
Reference
https://www.sustainablefinance.uzh.ch/en/research/climate-fever.html… See the full description on the dataset page: https://huggingface.co/datasets/mteb/climate-fever-v2.pl_ps_prompted_mergedfever-ner
FEVER Entity Retrieval Benchmark
Frozen benchmark for evaluating retrieval methods on the BEIR FEVER dataset (5.4M Wikipedia articles, 6,666 test queries). All data is pre-built so you can test a new method without re-running BM25 or dense retrieval.
Files
Core benchmark data (for testing new methods)
File
Size
What it is
beir_pool.json
31 MB
BM25 top-100 candidate pool (k1=1.2, b=0.75). 6,666 queries, each with 100 candidate docids +… See the full description on the dataset page: https://huggingface.co/datasets/Kim-el/fever-ner.FEVERfev-bench-lite-n3guard-blindspots-tr
guard-blindspots-tr
from datasets import load_dataset
ds = load_dataset("fevziegeyurtsevenler/guard-blindspots-tr")
248 Turkish prompt injections scored through popular open guard models. An English-good guard is not automatically Turkish-good.
Guard
Turkish miss-rate
fmops/distilbert-prompt-injection
0.0%
AltaySec detector
0.8%
protectai/deberta-v3-base-prompt-injection-v2
1.6%
jackhhao/jailbreak-classifier
85.5%
Each row: text, technique, category… See the full description on the dataset page: https://huggingface.co/datasets/fevziegeyurtsevenler/guard-blindspots-tr.fever_2wayeval_pick-place-fevi-stik-dataset_v1_ACTThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so101_follower",
"total_episodes": 10,
"total_frames": 3527,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:10"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/dreamerparadise/eval_pick-place-fevi-stik-dataset_v1_ACT.africa-synth-climate-rift-valley-fever-surveillance-all
Rift Valley Fever Surveillance | Africa (Electric Sheep Africa metadata inventory)
Size category: 10K<n<100K - Formats: csv - Sector: health - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Health datasets help… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-synth-climate-rift-valley-fever-surveillance-all.fever-nei-wiki-basedpick-place-fevi-stik-datasetThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so101_follower",
"total_episodes": 50,
"total_frames": 20287,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/dreamerparadise/pick-place-fevi-stik-dataset.so100_pick_and_place_eleves_si_fevrier2026This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 50,
"total_frames": 12013,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 15,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/tomduf70/so100_pick_and_place_eleves_si_fevrier2026.eval_pick-place-fevi-stik-dataset_v6_ACTThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so101_follower",
"total_episodes": 10,
"total_frames": 3669,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:10"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/dreamerparadise/eval_pick-place-fevi-stik-dataset_v6_ACT.dataset-injection-scan-study
Dataset Injection Scan — open study of popular HF datasets
from datasets import load_dataset
ds = load_dataset("fevziegeyurtsevenler/dataset-injection-scan-study")
Results of scanning 17,000 rows across 6 popular public instruction/prompt datasets for
smuggled prompt-injection with hf-dataset-scan
(invisible Unicode, injection phrasing EN+TR, exfil URLs).
Headline: no smuggled injection found
Dataset
Rows
Flagged
High
Med
Low
tatsu-lab/alpaca
3,000
0… See the full description on the dataset page: https://huggingface.co/datasets/fevziegeyurtsevenler/dataset-injection-scan-study.ncdc_lassa_fever_timeseries
NCDC Lassa Fever Weekly Timeseries Dataset (Nigeria, 2020–2025)
Version: 1.0
Maintainer: Emmanuel Niyi-Oriolowo
License: CC BY 4.0
Last Updated: 01-12-2025
1. Overview
This repository provides a consolidated and standardized dataset of weekly Lassa fever surveillance data in Nigeria from 2020 to 2025. The dataset is derived from the Nigeria Centre for Disease Control (NCDC) Weekly Epidemiological Reports, which are published as PDF documents.
The primary objective of… See the full description on the dataset page: https://huggingface.co/datasets/EmanuelN/ncdc_lassa_fever_timeseries.eval_pick-place-fevi-stik-dataset_v2_ACTThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so101_follower",
"total_episodes": 10,
"total_frames": 3596,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:10"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/dreamerparadise/eval_pick-place-fevi-stik-dataset_v2_ACT.