datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
cissp-llmbench
CISSP-LLMBench
Nova
NOVA: A Benchmark for Anomaly Localization and Clinical Reasoning in Brain MRI
An open-world generalization benchmark under clinical distribution shift
Dataset on 🤗 Hugging FaceFor academic, non-commercial use only
🔖 Citation
If you find this dataset useful in your work, please consider citing it:
@article{bercea2025nova,
title={NOVA: A Benchmark for Anomaly Localization and Clinical Reasoning in Brain MRI},
author={Bercea, Cosmin I. and Li, Jun and… See the full description on the dataset page: https://huggingface.co/datasets/c-i-ber/Nova.CIMA-4.8-ADR
CIMA Sección 4.8 — Reacciones Adversas
Corpus de texto biomédico regulatorio en español compuesto por la
sección 4.8 ("Reacciones adversas") de la totalidad de las fichas
técnicas publicadas por la
Agencia Española de Medicamentos y Productos Sanitarios (AEMPS)
en su Centro de Información Online de Medicamentos
(CIMA).
Este recurso fue construido como base para el pre-entrenamiento
adaptado al dominio (continued pre-training / domain-adaptive
pre-training, DAPT) de modelos… See the full description on the dataset page: https://huggingface.co/datasets/guerrerotook/CIMA-4.8-ADR.speculators-ci-datasets
speculator-tutorial
Raw vs. on-policy regenerated conversation data for training speculative-decoding
drafters (EAGLE-3 / DFlash / DSpark style), with the original source data kept alongside
so you can see exactly what regeneration changes and why it matters.
Prompts come from UltraChat-200k. The verifier / teacher model is Qwen/Qwen3-8B.
Why regenerate at all?
A speculative-decoding drafter is trained to predict what the verifier would say next.
If you train it… See the full description on the dataset page: https://huggingface.co/datasets/inference-optimization/speculators-ci-datasets.CID-Dataset
CID Dataset
Training and evaluation data for Continuous Interaction Diffusion (CID).
Paper: Continuous Interaction Diffusion: A Diffusion-Native Architecture for Asynchronous Tool-Augmented Reasoning — Yuhang Cao, Yanzhou Mu, Chunrong Fang, and Zhenyu Chen, arXiv:2608.10438 (2026).
CID-Dataset is a structured corpus for asynchronous tool-augmented reasoning. Its supervision is organized as semantic tasks, reviewed TeacherPlans, randomized runtime trajectories, and… See the full description on the dataset page: https://huggingface.co/datasets/fwerkor/CID-Dataset.CitationGround-1M
CitationGround-1M (Platinum)
Developer/Publisher: Within US AIVersion: 0.1.0 (sample pack)Created: 2025-12-30T16:53:41Z
What this dataset is
CitationGround-1M is a citation-locked grounded QA/RAG dataset:
Answer using only the provided contexts
Provide span-level citations (doc_id + offsets)
Includes answerable=false hard negatives for abstention behavior
Features / schema (JSONL)
example_id (string)
question (string)
contexts (list of docs)… See the full description on the dataset page: https://huggingface.co/datasets/WithinUsAI/CitationGround-1M.cibench-experiments
CIBench Experiments
Reproducibility packages for CIBench — the stateless, replayable benchmark engine for the 1M–10M token long-context era.
If a benchmark result cannot be replayed from its manifest alone, it did not happen.
Every sub-directory in this dataset is a self-contained experiment package: per-run manifests, content-addressed canonical JSON, ResultRecord with full scoring + signed provenance, per-item OpenTelemetry gen_ai_* call metrics, retrieved evidence, a… See the full description on the dataset page: https://huggingface.co/datasets/publicus-ai/cibench-experiments.CIDAR
Dataset Card for "CIDAR"
🌴CIDAR: Culturally Relevant Instruction Dataset For Arabic
[ Paper - GitHub ]
CIDAR contains 10,000 instructions and their output. The dataset was created by selecting around 9,109 samples from Alpagasus dataset then translating it to Arabic using ChatGPT. In addition, we append that with around 891 Arabic grammar instructions from the webiste Ask the teacher. All the 10,000 samples were reviewed by around 12 reviewers.
📚… See the full description on the dataset page: https://huggingface.co/datasets/arbml/CIDAR.L-CiteEval
L-CITEEVAL: DO LONG-CONTEXT MODELS TRULY LEVERAGE CONTEXT FOR RESPONDING?
Paper Github Zhihu
Benchmark Quickview
L-CiteEval is a multi-task long-context understanding with citation benchmark, covering 5 task categories, including single-document question answering, multi-document question answering, summarization, dialogue understanding, and synthetic tasks, encompassing 11 different long-context tasks. The context lengths for these tasks range from 8K to 48K.… See the full description on the dataset page: https://huggingface.co/datasets/Jonaszky123/L-CiteEval.wildtrace
WildTrace strict481
WildTrace is a source-internal long-context multi-hop reasoning benchmark
built from natural evidence trails. Unlike reverse-synthetic QA, its tasks are
mined in situ from long source documents before questions are written. The
strict481 release contains 481 locked tasks over 214 public long-form sources,
with full-document, evidence-withheld evaluation. The model under test receives
only the source document and the public question; evidence spans, clue… See the full description on the dataset page: https://huggingface.co/datasets/CinderD/wildtrace.wikifragments
WikiFragments
WikiFragments is a multimodal dataset built from Wikipedia (en), consisting of cleaned textual paragraphs paired with related images (infobox and thumbnail) from the same page. Each pair forms a multimodal fragment, which serves as an atomic knowledge unit ideal for information retrieval and multimodal research.
Example of a rendered fragment with multiple images and captions.
Fragment with only text and no associated images.
[!NOTE]The images above were generated… See the full description on the dataset page: https://huggingface.co/datasets/cilabuniba/wikifragments.greek_civics_qa
Dataset Card for Greek Civics QA
The Greek Civics QA dataset is a set of 407 question and answer pairs related to Greek highschool courses in civics (Κοινωνική και Πολιτική Αγωγή). The dataset was created by Nikoletta Tsoukala during her 2023 internship at the Institute for Language and Speech Processing/Athena RC, supervised by ILSP Research Associate Vassilis Papavassileiou. The dataset creation process involved mining questions and answers from two civics textbooks used in the… See the full description on the dataset page: https://huggingface.co/datasets/ilsp/greek_civics_qa.bentoThis dataset is based on MMLU, FLAN, Big Bench Hard and AgiEval English.
The non-"reduced" benchmark is the original benchmark, except for FLAN, which is a sampled version.
The "reduced" benchmark only contains a few representative tasks in the original ones, such that the performance on the "reduced" benchmark can serve as an approximation to the performance on the original ones.
llm-cipher-reasoning
llm-cipher-reasoning — data, eval results and full research ledger
Everything except the weights from a research run asking: can an LLM be trained to reason in a
more compact "language" than English, and does that actually save tokens?
Two linked lines of work on Qwen/Qwen3-4B-Instruct-2507:
Cipher invention / cross-model communication — cold-decoding tests, negotiated cipher
collusion between model pairs, a cipher-hardening arms race, and GEPA prompt optimization to get
a… See the full description on the dataset page: https://huggingface.co/datasets/AlexWortega/llm-cipher-reasoning.CIMD
Chinese Instruction Multimodal Data (CIMD)
The dataset contains one million Chinese image-text pairs in total, including detailed image captioning and visual question answering.
Generation Pipeline
Image source
We randomly sample images from two opensource datasets Wanjuan and Wukong
Detailed caption generation
We use Gemini Pro Vision API to generate a detailed description for each image.
Question-answer pairs generation
Based on the generated caption, we use Gemini… See the full description on the dataset page: https://huggingface.co/datasets/jingzi/CIMD.task1721_civil_comments_obscenity_classification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task1721_civil_comments_obscenity_classification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task1721_civil_comments_obscenity_classification.task1723_civil_comments_sexuallyexplicit_classification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task1723_civil_comments_sexuallyexplicit_classification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task1723_civil_comments_sexuallyexplicit_classification.photonic-integrated-circuit-yield
🏭 Photonic Integrated Circuit Yield Dataset
📊 125,000 synthetic (yield query, yield reasoning response) pairs covering process variation, defect density, lithography, and metrology challenges in CMOS-compatible photonic integrated circuit (PIC) manufacturing.
⚠️ Disclaimer: All entries are synthetically generated. Yield figures are computed from textbook models over sampled inputs, and citations are placeholders styled after technical sources; none reference a real… See the full description on the dataset page: https://huggingface.co/datasets/Taylor658/photonic-integrated-circuit-yield.GlotStoryBook
Dataset Description
Story Books for 180 ISO-639-3 codes.
The Parallel ID or parallel_id can be used to find the parallel documents in different languages and build a parallel dataset.
This dataset consists of 2 subsets:
default, which consists of 4 publishers:
asp: African Storybook
pb: Pratham Books
lcb: Little Cree Books
lida: LIDA Stories
nalibali, which comes from Nal'ibali stories.
Usage (HF Loader)
default:
from datasets import load_dataset
dataset… See the full description on the dataset page: https://huggingface.co/datasets/cis-lmu/GlotStoryBook.task1720_civil_comments_toxicity_classification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task1720_civil_comments_toxicity_classification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task1720_civil_comments_toxicity_classification.sebi-circulars
SEBI Circulars Dataset
A comprehensive, structured dataset of Indian Securities and Exchange Board (SEBI) regulatory circulars, public-domain government works compiled and annotated for AI/ML research.
Date: 2026-08-14
Snapshot Version: v2026.08
Corpus: 728 circulars (2010–2026)
Dataset Configurations
Config
Rows
Schema
Purpose
corpus
728
Full circular + metadata
Flagship: regulatory text, lineage, effective dates
chunks
78,585
Section-aware retrieval… See the full description on the dataset page: https://huggingface.co/datasets/opnsrcntrbtrian/sebi-circulars.Nemotron-RL-Instruction-Following-Citation-Formatting-v1
Dataset Description:
Teaches the model to cite specific document parts using reference markers like [ref:1], ref:3, etc. Supports single-reference, multi-reference, and inline citations.
This dataset is ready for commercial/non-commercial uses.
Dataset Owner(s):
NVIDIA Corporation
Dataset Creation Date:
Created on: April 10, 2026
Last Modified on: April 10, 2026
Version:
Nemotron-RL-Instruction-Following-CitationFormatting-v1… See the full description on the dataset page: https://huggingface.co/datasets/nvidia/Nemotron-RL-Instruction-Following-Citation-Formatting-v1.civil-code-phil
Civilex — Philippine Legal RAG & SFT Dataset
Retrieval corpus and supervised fine-tuning (SFT) data for a retrieval-augmented generation (RAG) pipeline over Philippine law: the Civil Code (Republic Act No. 386) and Supreme Court jurisprudence. Produced by the civilex-thesis research pipeline.
Contents: 11k+ Supreme Court jurisprudence cases spanning 1949–2025, and 2,270 articles from the Civil Code (Republic Act No. 386).
Dataset structure
.
├── README.md
├──… See the full description on the dataset page: https://huggingface.co/datasets/renzzyyy1028/civil-code-phil.task1724_civil_comments_insult_classification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task1724_civil_comments_insult_classification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task1724_civil_comments_insult_classification.task568_circa_question_generation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task568_circa_question_generation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task568_circa_question_generation.TeachArena
TeachArena
TeachArena is a benchmark for evaluating AI tutoring agents across the full teaching
decision chain — from moment-to-moment tutoring dialogue, to pedagogical judgment on
packaged evidence, to multi-step teaching workflows grounded in a learning-management
system. It contains 354 tasks organized into three stages, a mock LMS environment
database, the agent policy documents, and the full scoring logic.
Why three stages
A capable teaching agent must both… See the full description on the dataset page: https://huggingface.co/datasets/CinderD/TeachArena.civic-records-distill
civic-records-distill
Training data for a local model that helps a private citizen use public-records
law: draft requests that are hard to stall, turn an angry draft into a letter an
official has to engage with, look things up instead of inventing them, and
escalate correctly when stonewalled.
Grounded in Florida (ch. 119 Public Records Act, ch. 286 Sunshine Law, and
the ALPR-specific s. 316.0777) and Texas (ch. 552 Public Information Act,
ch. 551 Open Meetings Act).
Pipeline:… See the full description on the dataset page: https://huggingface.co/datasets/h0ney-badger/civic-records-distill.task1722_civil_comments_threat_classification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task1722_civil_comments_threat_classification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task1722_civil_comments_threat_classification.logdx-ci
LogDx-CI
A benchmark for CI log reduction tools
(RTK, grep, tail, hybrid routers,
LLM-summary) — do they preserve enough evidence for LLM root-cause
diagnosis?
Homepage: https://logdx-bench.github.io/
Code & evaluator: https://github.com/eyuansu62/LogDx
Headline report: reports/e10_v2_generalization_partial.md
Release notes: RELEASE_NOTES.md (latest: RELEASE_NOTES_v1_2.md)
Current release: v1.2
License: CC-BY-4.0 (data, this repo); Apache-2.0 (code, GH repo)
Two ways to… See the full description on the dataset page: https://huggingface.co/datasets/eyuansu71/logdx-ci.wikifragments-visual-arts-embeds
WikiFragments - Visual Arts Pages with Fragments (WikiFragmentsVA)
WikiFragmentsVA is a domain-specific multimodal dataset focused on the visual arts, derived from Wikipedia (en). It consists of textual paragraphs paired with related images (infoboxes and thumbnails), rendered as unified visual fragments. This dataset extends the base WikiFragments project by providing pre-rendered fragment images and multi-vector embeddings obtained via ColQwen2 v1.0, including optimized pooled… See the full description on the dataset page: https://huggingface.co/datasets/cilabuniba/wikifragments-visual-arts-embeds.