datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
fitcheck-annotate-datasetCEFR-Annotated-WordNet
CEFR-Annotated WordNet: LLM-Based Proficiency-Guided Semantic Database for Language Learning
Paper: CEFR-Annotated WordNet: LLM-Based Proficiency-Guided Semantic Database for Language Learning
Authors: Masato Kikuchi, Masatsugu Ono, Toshioki Soga, Tetsu Tanabe, Tadachika Ozono
Overview
CEFR-Annotated WordNet is a comprehensive semantic database that maps WordNet 3.0 senses and SemCor 3.0 instances to CEFR (Common European Framework of Reference for Languages)… See the full description on the dataset page: https://huggingface.co/datasets/star092304/CEFR-Annotated-WordNet.uds-annotated-tofulanguage:
en
license: mit
pretty_name: UDS-Annotated TOFU
task_categories:
question-answering
tags:
arxiv:2605.24614
unlearning
llm-unlearning
activation-patching
tofu
entity-annotation
UDS-Annotated TOFU
Annotated TOFU forget10 examples used in Measuring the Depth of LLM Unlearning via Activation Patching.
The dataset contains factual entity and span annotations used by the Unlearning Depth Score (UDS) pipeline to evaluate whether target knowledge remains recoverable from a… See the full description on the dataset page: https://huggingface.co/datasets/jaeunglee/uds-annotated-tofu.fever-span-annotated
FEVER (span annotated)
This dataset consists of the test set taken from the original FEVER dataset, as tsv files with the following example format:
query: Home Alone is a film.
document: Home Alone is a 1990 American Christmas comedy film written and produced by John Hughes and directed by Chris Columbus ...
spans: [121:270]
The spans indicate on character level, which sentences in the document are relevant to the claim, and are derived from the sentence level annotations of the… See the full description on the dataset page: https://huggingface.co/datasets/jinaai/fever-span-annotated.triviaqa-span-annotated
TriviaQA (span annotated)
This dataset consists of the test set taken from the original TriviaQA dataset, as tsv files with the following example format:
query: What is the Japanese product kakiemon?
document: "1000+ images about Kakiemon on Pinterest | Antiques, Vase and Products Learn more at rubylane.com Japanese Meiji-Showa Period Imari Porcelain Platter Red, White and Blue with Imperial Seal"
spans: [132:141]
The spans indicate on character level, which phrases or words in the… See the full description on the dataset page: https://huggingface.co/datasets/jinaai/triviaqa-span-annotated.chat-annotated
Annotated Human-AI Chats
Variable
Mean
Standard Deviation
safety
6.5310
1.0179
quality
7.8994
1.9667
difficulty
6.6519
2.1795
There are two columns for refusal:
refusal: the categories from agentlans/chat-refusal
refusal_classifier: the output of
agentlans/snowflake-arctic-embed-xs-refusal-classifier for English conversations
agentlans/multilingual-e5-small-refusal-classifier for non-English conversations
The accept column is true if safety > 5, quality > 6… See the full description on the dataset page: https://huggingface.co/datasets/agentlans/chat-annotated.real_world_data_annotated
Real-World Data — Camera-3 Annotations
This dataset provides perception annotations for 1,000 real robot demonstration
episodes across five tasks. It is the annotation companion to
mzxuan/real_world_data,
which contains the original recordings.
Download both datasets for visual robot-learning experiments. This repository
does not contain the original RGB, depth, robot state, or action commands. It
contains masks, object identities and roles, 2D/3D boxes, annotation-only HDF5… See the full description on the dataset page: https://huggingface.co/datasets/mzxuan/real_world_data_annotated.ai2thor-perspective-qa-2000-qa-v5-annotatedcrest-codeforces-annotated-problemsCREST (Code, Ratings, Editorials, Statements, and Tags) is a dataset of 8,941 annotated Codeforces problems. For each problem, the dataset includes:
The problem statement and tutorial (editorial) text, both of which are math-rich and contain LaTeX-formatted mathematical notation.
Reference solution code from the tutorial, when available.
A set of algorithmic tags.
A numerical difficulty rating.
The dataset supports tasks such as multilabel tag classification and rating regression from… See the full description on the dataset page: https://huggingface.co/datasets/ZaniteA/crest-codeforces-annotated-problems.annotated-isabelleExtensively annotated Isabelle source code, suitable for pretraining, about 500M tokens in Qwen3's tokenizer.
Data source: Isabelle/HOL + AFP 2025-02-12. Cases from the PISA benchmark are removed.
Example:
lemma (in group) diff_neutralizes: ✐‹contributor ‹Paulo EmÃlio de Vilhena››
assumes "subgroup H G" "R ∈ rcosets H"
shows "⋀r1 r2. ⟦ r1 ∈ R; r2 ∈ R ⟧ ⟹ r1 ⊗ (inv r2) ∈ H"
proof (-)
(*goal: ‹⋀r1 r2. ⟦r1 ∈ R; r2 ∈ R⟧ ⟹ r1 ⊗ inv r2 ∈ H›*)
fix r1 and r2
assume r1: "r1 ∈ R" and r2: "r2… See the full description on the dataset page: https://huggingface.co/datasets/ANTPG/annotated-isabelle.tulu-3-pool-annotated
Tulu-3-Pool-Annotated
Project | Github | Paper | HuggingFace's collection
Annotated tulu-3-sft-mixture. Used as a data pool in MIG. The annotations include #InsTag tags, DEITA scores, and CaR scores.
Dataset Details
Tulu3 Dataset Sources
Repository: https://huggingface.co/datasets/allenai/tulu-3-sft-mixture
Paper [optional]: Tulu 3: Pushing Frontiers in Open Language Model Post-Training
MIG Dataset Sources
Repository:… See the full description on the dataset page: https://huggingface.co/datasets/xsample/tulu-3-pool-annotated.ant_annotatednaganlp-ner-annotated-corpus
NagaNLP NER Annotated Corpus
Dataset Summary
This dataset contains 214 sentences in Nagamese (Naga Pidgin) annotated for both
Named Entity Recognition (NER) and Part-of-Speech (POS) tagging. It is
part of the NagaNLP project, which aims to build foundational NLP resources
for Nagamese, a low-resource Assamese-lexified creole spoken across Nagaland
and the wider Northeast India region.
Supported Tasks
Named Entity Recognition (primary): BIO-tagged… See the full description on the dataset page: https://huggingface.co/datasets/agnivamaiti/naganlp-ner-annotated-corpus.OpenMath-Difficulty-Annotated
📐 OpenMath-Difficulty-Annotated
🚀 Overview
OpenMath-Difficulty-Annotated is a curated subset of OpenMathInstruct-2 containing 10,176 math problems, enhanced with precise difficulty metadata.
While the original solutions are preserved from NVIDIA's dataset, we employed a 120B Parameter Model (LLM-as-a-Judge) to analyze and grade every single problem on a scale of 1 to 5.
This allows developers of Small Language Models (1B-3B) to filter out "Olympiad-level" noise… See the full description on the dataset page: https://huggingface.co/datasets/HAD653/OpenMath-Difficulty-Annotated.naganlp-pos-annotated-corpus
NagaNLP POS Annotated Corpus
Dataset Summary
This dataset contains 214 sentences in Nagamese (Naga Pidgin) annotated for
Part-of-Speech (POS) tagging. It is part of the NagaNLP project, which
builds foundational NLP resources for Nagamese, a low-resource creole spoken
across Nagaland and the wider Northeast India region. This dataset shares its
underlying sentences with naganlp-ner-annotated-corpus, but is published
standalone as a lighter-weight resource for… See the full description on the dataset page: https://huggingface.co/datasets/agnivamaiti/naganlp-pos-annotated-corpus.model-card-sentences-annotatedtrain-rl-o1-mini-annotated-math-numina-22kopenhermes-2.5-pool-annotated
Openhermes-2.5-Pool-Annotated
Annotated Openhermes-2.5. Used as a data pool in MIG. The annotations include #InsTag tags, DEITA scores, and CaR scores.
Dataset Details
Dataset Sources
Repository: https://huggingface.co/datasets/teknium/OpenHermes-2.5
Citation
BibTeX:
@misc{OpenHermes 2.5,
title = {OpenHermes 2.5: An Open Dataset of Synthetic Data for Generalist LLM Assistants},
author = {Teknium},
year = {2023},
publisher… See the full description on the dataset page: https://huggingface.co/datasets/xsample/openhermes-2.5-pool-annotated.manual_annotated_dataAnnotated_Persuasive_Essays
Full Free Sample Dataset of 150 Annotated Essays available at https://driftlogic.ai
Join the conversation and let us hear your feedback/suggestions! https://discord.gg/PHp9SPRB
license: cc-by-nc-4.0
language:
- en
tags:
- ai
- machine-learning
- dataset
- ai/ml
- argument-mining
- argument
pretty_name: Sample Annotated Persuasive Essay Dataset
size_categories:
- n<1K
Persuasive Essay Argument-Mining Sample Dataset
This is a sample dataset that… See the full description on the dataset page: https://huggingface.co/datasets/DriftLogic/Annotated_Persuasive_Essays.annotated_chess_gamescmi-annotatealpaca-prompts-annotated
Alpaca Annotated Dataset
This dataset includes prompts taken from yahma/alpaca-cleaned that have been annotated using the nvidia/prompt-task-and-complexity-classifier.
Each entry separates the instruction and input fields with two newline characters (\n\n).
The annotations describe the type of task and its complexity, as determined by NVIDIA’s classifier.
To know more about what each annotation means, see the classifier’s page on Hugging Face.
The prompts have been randomly… See the full description on the dataset page: https://huggingface.co/datasets/agentlans/alpaca-prompts-annotated.hutsul-manually-annotatedesnlir-al-annotated-test
ESNLIR — human-annotated evaluation set
1,695 human-annotated premise–hypothesis pairs spanning 24 domains and 8 genres, built as the
evaluation set for active-learning experiments on the ESNLIR corpus.
Active Learning for Spanish Natural Language Inference on a Heterogeneous Multi-Domain Corpus
Diego Ortiz, Johan R. Portela, Ruben Manrique — Universidad de los Andes, Bogotá
Advances in Artificial Intelligence — IBERAMIA 2026 (to appear)
Code:… See the full description on the dataset page: https://huggingface.co/datasets/Flaglab/esnlir-al-annotated-test.annotated_kheed
KHEED Dataset Card
Summary
The Khmer Health Event Extraction Dataset (KHEED) is designed for named entity recognition in the Khmer language, specially in the health domain. The data was crawled from Khmer news websites. This dataset includes eight entity types:
Disease (DIS)
Location (LOC)
Organization (ORG)
HumanCount (HUM)
Pathogen (PAT)
Date (DAT)
Symptom (SYM)
Medication (MED)
Please note that the dataset should be used with caution, as it may contain mislabeled… See the full description on the dataset page: https://huggingface.co/datasets/Cheaminh/annotated_kheed.train-rl-o1-mini-annotated-magpie-hard-math-22kdeita-sota-pool-annotated
Deita-Sota-Pool-Annotated
Annotated Deia-Sota-Pool. Used as a data pool in MIG. The annotations include #InsTag tags, DEITA scores, and CaR scores.
Dataset Details
Dataset Sources
Repository: https://huggingface.co/datasets/AndrewZeng/deita_sota_pool
Citation
BibTeX:
oath-frames-expert-multiply-annotatedFEDERICO-GARCIA-LORCA-canciones-poemas-romances-annotated
Federico García Lorca - Annotated Poetry Dataset
A curated and annotated dataset of 283 poems by Federico García Lorca, spanning 9 of his major works (1921--1940). Each poem is enriched with publication metadata and GPT-4-generated thematic and contextual annotations.
Use Case: LLM Generalization Evaluation
This dataset was created to evaluate how well large language models can generalize literary style from a small, domain-specific corpus. It has been used to fine-tune… See the full description on the dataset page: https://huggingface.co/datasets/xaviviro/FEDERICO-GARCIA-LORCA-canciones-poemas-romances-annotated.