datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
IFEval
Dataset Card for IFEval
Dataset Summary
This dataset contains the prompts used in the Instruction-Following Eval (IFEval) benchmark for large language models. It contains around 500 "verifiable instructions" such as "write in more than 400 words" and "mention the keyword of AI at least 3 times" which can be verified by heuristics. To load the dataset, run:
from datasets import load_dataset
ifeval = load_dataset("google/IFEval")
Supported Tasks and… See the full description on the dataset page: https://huggingface.co/datasets/google/IFEval.wmt24pp
WMT24++
This repository contains the human translation and post-edit data for the 55 en->xx language pairs released in
the publication
WMT24++: Expanding the Language Coverage of WMT24 to 55 Languages & Dialects.
If you are interested in the MT/LLM system outputs and automatic metric scores, please see MTME.
If you are interested in the images of the source URLs for each document, please see here.
Schema
Each language pair is stored in its own jsonl file.
Each row… See the full description on the dataset page: https://huggingface.co/datasets/google/wmt24pp.fever_gold_evidence
Dataset Card for fever_gold_evidence
Dataset Summary
Dataset for training classification-only fact checking with claims from the FEVER dataset.
This dataset is used in the paper "Generating Label Cohesive and Well-Formed Adversarial Claims", EMNLP 2020
The evidence is the gold evidence from the FEVER dataset for REFUTE and SUPPORT claims.
For NEI claims, we extract evidence sentences with the system in "Christopher Malon. 2018. Team Papelo: Transformer Networks at FEVER.… See the full description on the dataset page: https://huggingface.co/datasets/copenlu/fever_gold_evidence.xauusd-gold-price-historical-data-2004-2025
XAUUSD Gold Price Historical Data 2004-2025
This dataset contains historical price data for XAUUSD (Gold vs US Dollar) from 2004 to 2025.
Source: Kaggle dataset "novandraanugrah/xauusd-gold-price-historical-data-2004-2024"
Content:
The dataset includes CSV files with different time granularities (e.g., 1 minute, 5 minutes, 1 hour, 1 day). Each file typically contains the following columns:
Date
Open
High
Low
Close
Volume
Usage:
This dataset can be used for analyzing historical… See the full description on the dataset page: https://huggingface.co/datasets/ZombitX64/xauusd-gold-price-historical-data-2004-2025.Function_Calling_Unfilteredmsi-corpus
Main Street Independent Corpus
The complete Main Street Independent archive as open data: 917 news articles and 0 opinion columns, each with full text and metadata. AI-generated news and opinion, dedicated to the public domain under CC0 — no rights reserved. Refreshed daily.
Load it
from datasets import load_dataset
ds = load_dataset("golfplan18/msi-corpus") # 'news' and 'opinion' splits
print(ds["news"][0]["headline"], ds["news"][0]["text"][:200])… See the full description on the dataset page: https://huggingface.co/datasets/golfplan18/msi-corpus.spiqa
SPIQA Dataset Card
Dataset Details
Dataset Name: SPIQA (Scientific Paper Image Question Answering)
Paper: SPIQA: A Dataset for Multimodal Question Answering on Scientific Papers
Github: SPIQA eval and metrics code repo
Dataset Summary: SPIQA is a large-scale and challenging QA dataset focused on figures, tables, and text paragraphs from scientific research papers in various computer science domains. The figures cover a wide variety of plots… See the full description on the dataset page: https://huggingface.co/datasets/google/spiqa.mobile-actions
Mobile Actions: A Dataset for On-Device Function Calling
The dataset contains conversational traces designed to train lightweight models (such as FunctionGemma 270M) to translate natural language instructions into executable function calls for Android OS system tools.
Dataset Format
The dataset is provided in JSONL format. Each line represents a data sample. The
dataset is pre-split into training and evaluation sets. This distinction is
denoted by the metadata field… See the full description on the dataset page: https://huggingface.co/datasets/google/mobile-actions.gspc-gov
GSPC — governance bank (GovBench)
Bank (governance). Frozen split. Live n is the governance row on GET https://councilof.ai/api/gspc, not a Hub leaderboard score. Not a certificate.
Art 50 dates (EUR-Lex): 2 August 2026 live; marking grace 2 December 2026.
Council of AI measurement bank. Measurement, not certification.
Live measurement. This bank stands behind the governance row of the live GSPC board: GET https://councilof.ai/api/gspc?axis=governance (family, kind, status and… See the full description on the dataset page: https://huggingface.co/datasets/csoai/gspc-gov.multi-session_chatNot my dataset, I only cleaned the dataset from ParlAI - Msc.
go_emotions
GoEmotions
This dataset is a port of the official go_emotions dataset on the Hub. It only contains the simplified subset as these are the only fields we need for text classification.
uds-governance-receipts
Part of the SZL Holdings governed estate — claims are designed to carry checkable receipts. Verification proves integrity & origin, never accuracy or performance.
UDS Governance Receipts — Decision Audit Log
Doctrine v11 LOCKED. No marketing. Every number resolves to a CI log, a Lean proof, or a Zenodo DOI.
Append-only log of DSSE-signed governance decision receipts for the Unified Deployment Substrate (UDS) mesh. Each record captures:… See the full description on the dataset page: https://huggingface.co/datasets/SZLHOLDINGS/uds-governance-receipts.genomes-v3-genome_set-vertebrates-intervals-v3_512_256genomes-v3-genome_set-vertebrates-intervals-v2_512_256MathOlympiadBenchThis repository contains the MathOlympiadBench dataset, which is introduced in the paper Goedel-Prover-V2: Scaling Formal Theorem Proving with Scaffolded Data Synthesis and Self-Correction.
Project Page: https://blog.goedel-prover.com
Code Repository: https://github.com/Goedel-LM/Goedel-Prover-V2
MathOlympiadBench (Math Olympiad) comprises human-verified formalizations of Olympiad-level mathematical competition problems, sourced from Compfiles and IMOSLLean4 repository. MathOlympiadBench… See the full description on the dataset page: https://huggingface.co/datasets/Goedel-LM/MathOlympiadBench.gspc-jail-goldbank
GSPC — jail bank (GoldBank-Detector)
Council of AI measurement bank. Measurement, not certification.
Bank. Frozen split. Live n is the matching axis on GET https://councilof.ai/api/gspc, not a Hub score. Not a certificate. Art 50 (EUR-Lex): 2 August 2026 live; marking grace 2 December 2026.
Live measurement. This bank stands behind the jail row of the live GSPC board: GET https://councilof.ai/api/gspc?axis=jail (family, kind, status and n are on that row, never typed here; the… See the full description on the dataset page: https://huggingface.co/datasets/csoai/gspc-jail-goldbank.safim
SAFIM Benchmark
Syntax-Aware Fill-in-the-Middle (SAFIM) is a benchmark for evaluating Large Language Models (LLMs) on
the code Fill-in-the-Middle (FIM) task. SAFIM has three subtasks: Algorithmic Block Completion,
Control-Flow Expression Completion, and API Function Call Completion. SAFIM is sourced from code
submitted from April 2022 to January 2023 to minimize the impact of data contamination on evaluation
results.
Authors: Linyuan Gong, Sida Wang, Mostafa Elhoushi, Alvin Cheung… See the full description on the dataset page: https://huggingface.co/datasets/gonglinyuan/safim.ENERGY_DATAamazon_reviews_multi
Amazon Reviews Multi (Data Files Version)
This dataset hosts the multilingual Amazon Reviews corpus as raw jsonl.gz data files for direct loading via datasets without using a dataset script.
Source
Original dataset name: amazon_reviews_multi
Original dataset card: https://huggingface.co/datasets/amazon_reviews_multi
Mirror used for raw file retrieval: https://huggingface.co/datasets/buruzaemon/amazon_reviews_multi
Features
Each record contains:
review_id… See the full description on the dataset page: https://huggingface.co/datasets/goosmanlei/amazon_reviews_multi.genomes-v3-genome_set-animals-intervals-v3_512_256genomes-v2-genome_set-mammals-intervals-v2_512_256genomes-v3-genome_set-animals-intervals-v2_512_256genomes-v2-genome_set-vertebrates-intervals-v2_512_256that-one-google-math-datasetapolocheese for poor format, it's because I Don't Care (i'm tired and still working)
data from: https://github.com/google-deepmind/mathematics_dataset
from huggingface_hub import snapshot_download
from datasets import load_dataset
import os
def get_all_files(directory):
file_paths = []
for root, dirs, files in os.walk(directory):
for name in files:
full_path = os.path.join(root, name)
file_paths.append(os.path.abspath(full_path))
return file_paths… See the full description on the dataset page: https://huggingface.co/datasets/midwestern-simulation/that-one-google-math-dataset.genomes-v2-genome_set-primates-intervals-v1_512_256rag-bench
Dataset card for RAG-BENCH
Data Summary
RAG-bench aims to provide results of many commonly used RAG datasets. All the results in this dataset are evaluated by the RAG evaluation tool Rageval, which could be easily reproduced with the tool.
Currently, we have provided the results of ASQA dataset,ELI5 dataset and HotPotQA dataset.
Data Instance
ASQA
{
"ambiguous_question":"Who is the original artist of sound of silence?",
"qa_pairs":[{… See the full description on the dataset page: https://huggingface.co/datasets/golaxy/rag-bench.genomes-v2-genome_set-animals-intervals-v1_512_256pose6daug
pose6daug
Real-world Franka manipulation episodes with object-swap and action augmentation
artifacts. 120 training episodes over 4 objects (blue_cup, green_pear, kanu,
white_spray), dual ZED cameras (exo static + ego wrist-mounted).
Layout
Per-frame PNGs are packed into uncompressed tars per episode — the dataset has
~427k mask/plate frames and loose files hit Hugging Face's per-repo file
recommendation and API rate limits hard.
data/<object>/<NNNN>/
masks.tar… See the full description on the dataset page: https://huggingface.co/datasets/Ronaldo-GOAT/pose6daug.cs_csfd-movie-reviews
Dataset Card for CSFD movie reviews (Czech)
Dataset Description
The dataset contains user reviews from Czech/Slovak movie databse website https://csfd.cz.
Each review contains text, rating, date, and basic information about the movie (or TV series).
The dataset has in total (train+validation+test) 30,000 reviews. The data is balanced - each rating has approximately the same frequency.
Dataset Features
Each sample contains:
review_id: unique string identifier… See the full description on the dataset page: https://huggingface.co/datasets/fewshot-goes-multilingual/cs_csfd-movie-reviews.reward-projection-goal-generalisation-vlm