datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
multi_reference_image_editing
Multi-Reference Instruction-Based Image Editing Dataset
Overview
This dataset contains 20,000 high-resolution image pairs and multi-modal instructions designed for training advanced image-to-image editing models. It combines two complementary example types: 10,000 reference-grounded edits, where structural or stylistic changes are driven by up to three provided visual reference images, and 10,000 occlusion-based inpainting/outpainting edits, where the model must… See the full description on the dataset page: https://huggingface.co/datasets/molbal/multi_reference_image_editing.watercolour-reference-pool
Watercolour reference pool
The reference paintings that define the reward in the watercolour RL environment: an
agent writes a p5.brush sketch, the sketch is
rendered, and a vision judge compares the render against paintings sampled from this pool.
What the pool contains is the reward function. Replace it and you have changed what
the environment rewards, without touching a line of code.
178 paintings in two tiers, each with the JavaScript source that produced it.
tier… See the full description on the dataset page: https://huggingface.co/datasets/FineEnvs/watercolour-reference-pool.references
GEM References
What is it?
This repository contains all the reference datasets that are used for running evaluation on the GEM benchmark. Some of these datasets were originally hosted as a GitHub release on the GEM-metrics repository, but have been migrated to the Hugging Face Hub.
Converting datasets to JSON
We provide a convert_dataset_to_json.py conversion script that converts the datasets in the GEM organisation to the JSON format expected by the… See the full description on the dataset page: https://huggingface.co/datasets/GEM/references.asset-alignment-reference-views
Asset Alignment Reference Views
Companion dataset for the paper "Rigid 3D Object Alignment: Optimization vs. Feed-Forward Prediction".
Multi-view renderings of correctly assembled source–target pairs: each row
shows one asset already aligned onto its target object, rendered from 12
orbiting viewpoints with RGB and depth.
Where asset-alignment-pairs-905k
shows the asset misaligned and supplies the transformation that fixes it, this
dataset shows the ground-truth assembled result.… See the full description on the dataset page: https://huggingface.co/datasets/macpaw-research/asset-alignment-reference-views.asr-reference-set-eval-temp
Temporary ASR evaluation audio
Temporary public audio files used for hosted ASR evaluation.
moss-voice-profile-references
MOSS voice-profile references
Complete voice profiles: one reference speaker rendered through a matrix of named acting
conditions in English and German, with every candidate take kept — not just the winner — and
every take scored on itself.
Two releases live here.
voices
groups / voice
candidates / group
rows
audio
audio variants
pilot/ — the ten pilot voices
10
842
48
402,560
853.5 h
raw
root — Velvet Sage Baritone
1
832
32
106,424
239.6 h
raw, vc, raw_sidon… See the full description on the dataset page: https://huggingface.co/datasets/TTS-AGI/moss-voice-profile-references.gdpval-office-round-trip-reference-filesentity-references
Entity References Database
A comprehensive entity database for organizations, people, roles, and locations with embedding-based semantic search. Built from authoritative sources (GLEIF, SEC, Companies House, Wikidata) for entity linking and named entity disambiguation.
Dataset Summary
This dataset provides fast lookup and qualification of named entities using vector similarity search. It stores records from authoritative global sources with embeddings generated by… See the full description on the dataset page: https://huggingface.co/datasets/Corp-o-Rate-Community/entity-references.captini-scoring-referencesCeltic_Stems_Reference_Sessions_Preview
Harmonic Frontier Audio – Celtic Constellation Reference Sessions (Preview, v0.9)
A high-fidelity music-production dataset designed to connect isolated source performances, production processing, arrangement context, and finished musical outcomes.
Celtic Constellation Reference Sessions (Preview), created by Harmonic Frontier Audio, introduces the Reference Sessions product vertical through a compact proof-of-concept built around purpose-recorded Celtic ensemble material.… See the full description on the dataset page: https://huggingface.co/datasets/Harmonic-Frontier-Audio/Celtic_Stems_Reference_Sessions_Preview.tldr-with-sft-referenceGreek_Legal_Reference_Texts
NOMOS_Greek_Legislation
NOMOS_Greek_Legislation is a Greek-language legal text corpus derived from the National Printing House (Ethniko Typografeio - ET.gr).
The dataset focuses on Greek national legislation (Laws, Presidential Decrees, Ministerial Decisions) and was developed in the context of the +NOMOS project.
It provides full-text legal documents enriched with metadata and thematic classification tags, suitable for Legal NLP tasks such as Text Classification and Language… See the full description on the dataset page: https://huggingface.co/datasets/syn-nomos/Greek_Legal_Reference_Texts.spain-reference-personas-frontier
Spain Reference Personas Frontier
Spain Reference Personas Frontier is an open synthetic reference population and benchmark substrate for evaluating and designing socially grounded AI systems for Spain.
It is not observed microdata, not a survey, not a prediction of real citizens, and not a substitute for fieldwork, administrative data, or domain-specific validation.
The package is designed for simulation, evaluation, prompt conditioning, subgroup analysis, service design… See the full description on the dataset page: https://huggingface.co/datasets/apol/spain-reference-personas-frontier.test_referencesSpatial-Reference-Grid
WORK IN PROGRESS...
Spatial-Reference-Grid
The MajorTom spatial reference grid is now available as spatial data, provided in both GeoParquet and GeoPackage formats.
It is a global grid containing 5,091,140 cells.
Metadata content
Field
Type
Description
grid_cell
string
Major TOM cell
grid_row_u
int
Major TOM cell row
grid_col_rint
Major TOM cell col
utm_crs
string
CRS of the original product
centre_lat
float
Centre of the of the… See the full description on the dataset page: https://huggingface.co/datasets/Major-TOM/Spatial-Reference-Grid.state-civil-statute-of-limitations
Civil statute of limitations by state and type of claim
Canonical, always-current version: https://referencesource.org/state-civil-statute-of-limitations/
Machine-readable: https://referencesource.org/state-civil-statute-of-limitations/data.json — this mirror is a point-in-time copy.
Last verified: 2026-08-25
Stale after: 2027-08-25 (past this date, prefer the canonical copy —
it re-verifies on a cadence this snapshot does not)
Records: 238
How long do you have to sue? Every… See the full description on the dataset page: https://huggingface.co/datasets/referencesource/state-civil-statute-of-limitations.bible-reference
Bible Reference Corpus
Thirteen aligned reference datasets for study of the biblical text: Greek and
Hebrew lexicons keyed to Strong's numbers, an interlinear word map, the critical
apparatus of eight Greek editions, cross-reference and topical indexes, and
geolocated places.
Published by SermonIndex.
Everything in this repository is public domain or CC BY 4.0. Sources with
share-alike terms are kept in a separate repository,
sermonindex/bible-reference-sa,
so that a share-alike… See the full description on the dataset page: https://huggingface.co/datasets/sermonindex/bible-reference.ai-glossary-reference
AI Glossary
10,200 unique artificial intelligence and machine learning terms with concise definitions, a category, a difficulty level, and links to related terms. 149,760 words of definitions across 38 categories.
Usage
from datasets import load_dataset
ds = load_dataset("whoashish115/ai-glossary-reference", split="train")
The same rows are also provided as ai_glossary.jsonl and ai_glossary.csv (related terms joined with ; ).
Fields
Field… See the full description on the dataset page: https://huggingface.co/datasets/whoashish115/ai-glossary-reference.Stylistics_Reference_Repository
MoSEs Dataset: Stylistics Reference Repository(SRR)
This dataset is part of the MoSEs framework for AI-generated text detection, containing both human-written and AI-generated text data used in the paper "MoSEs: Uncertainty-Aware AI-Generated Text Detection via Mixture of Stylistics Experts with Conditional Thresholds" (Wu et al., 2025).
Dataset Overview
This dataset contains two text detection benchmark subsets used for training and evaluation in the MoSEs framework.… See the full description on the dataset page: https://huggingface.co/datasets/zhengliu8/Stylistics_Reference_Repository.political_reference_newspaperslingvanex_test_references
LTR
LTR -- Lingvanex Test References for MT Evaluation from English into a total of 30 target languages for a big variety of cases.
TEST CASES
Parameter
Description
Length
Sentences from 1 to 100 words.
Domain
Medicine (12%), Automobile (11%), Finance (8%)
Tokenizer
Jupiter is 1.000.000 km far. Ask Mr. Johnson for training
Tags
I want to eat and swim
Capitalisation (Case)
HELLO my Dear frIEND
Different languages in one text (Up to 3 languages)
I see… See the full description on the dataset page: https://huggingface.co/datasets/lingvanex/lingvanex_test_references.Emotion-Voice-Attribute-Reference-Snippets-DACVAE-Wave
Emotion and Voice Attribute Reference Snippets - DACVAE and Wave
Merged dataset combining TTS-AGI/enhanced-emo-snippets-balanced-DACVAE and
TTS-AGI/emotion-attribute-conditioning-dacvae with decoded WAV audio.
Overview
Total samples: 606,178
Filtered out: 363,331 (samples with speech_quality < 1.8)
Total tar files: 328
Total size: 1.54 TB
Audio format: WAV, 48kHz, PCM 16-bit mono
Latents: DAC-VAE float16 [T, 128] at 25 frames/sec
Dimensions: 57 (40 emotions + 15 voice… See the full description on the dataset page: https://huggingface.co/datasets/TTS-AGI/Emotion-Voice-Attribute-Reference-Snippets-DACVAE-Wave.hazmat-segregation-matrix
Hazmat load segregation — which hazard classes may travel together, highway vs vessel
Canonical, always-current version: https://referencesource.org/hazmat-segregation-matrix/
Machine-readable: https://referencesource.org/hazmat-segregation-matrix/data.json — this mirror is a point-in-time copy.
Last verified: 2026-08-10
Stale after: 2027-08-10 (past this date, prefer the canonical copy —
it re-verifies on a cadence this snapshot does not)
Records: 788
The pairwise… See the full description on the dataset page: https://huggingface.co/datasets/referencesource/hazmat-segregation-matrix.InstaDeepAI_human_reference_genomestyle-reference-captionsoptimal-reference-translationsThis is the dataset for two papers: Quality and Quantity of Machine Translation References for Automated Metrics [paper] - effect of reference quality and quantity on automatic metric performance, and Evaluating Optimal Reference Translations [paper] - creation of the data and human aspects of annotation and translation.
Please see the original repository for more information and the raw data or contact the authors with any questions.
Please make sure that you have the latest datasets… See the full description on the dataset page: https://huggingface.co/datasets/zouhar/optimal-reference-translations.data-breach-notification-clocks
US state data breach notification deadlines by state
Canonical, always-current version: https://referencesource.org/data-breach-notification-clocks/
Machine-readable: https://referencesource.org/data-breach-notification-clocks/data.json — this mirror is a point-in-time copy.
Last verified: 2026-08-18
Stale after: 2027-02-14 (past this date, prefer the canonical copy —
it re-verifies on a cadence this snapshot does not)
Records: 18
US state-by-state data breach notification… See the full description on the dataset page: https://huggingface.co/datasets/referencesource/data-breach-notification-clocks.pokemon-card-sold-price-reference
Pokémon Card Sold-Price Reference by Grade — Raw, PSA 9, PSA 10 (486 Cards, 2026)
Median sold-price reference for 486 Pokémon cards across raw (ungraded), PSA 9, and PSA 10 eBay sales, compiled from real graded and ungraded sold comps (PokemonPriceTracker sold-listing data). 486 of 486 cards have a PSA 9 comp; the median PSA-10-over-PSA-9 grading premium across cards with both is 4.9×. Reference pricing only — sample sizes and confidence flags are included so nobody treats a… See the full description on the dataset page: https://huggingface.co/datasets/rrhagentbiz/pokemon-card-sold-price-reference.glm51-kld-reference-logits-wikitext-ctx2048-s512-20260517 ---
license: other
pretty_name: GLM-5.1 KLD Reference Logits WikiText ctx2048 s512
tags:
- logits
- kld
- glm-5.1
- vllm
- b12x
---
# GLM-5.1 KLD Reference Logits
Public cache of the reference logits used for GLM-5.1 NVFP4 / mixed
FP8_PB_WO KLD evaluation. These files are generated logits, not model
weights. They are stored as `logits_*.safetensors` with one tensor named
`logits`, shape `(2047, 154880)`, dtype `float32`.
##… See the full description on the dataset page: https://huggingface.co/datasets/festr2/glm51-kld-reference-logits-wikitext-ctx2048-s512-20260517.plant-reference-genomesThis is the dataset used for pre-trained plant foundation DNA large language models.
The dataset contains a collection of 22 plant reference genomes. Genome sequences are processed to fit lengths range from 1 bp to 2000 bp.Both hardmasked genomes and unmasked genomes are used to generate the pre-train dataset.