datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
transformers-metadata
Transformers metadata
transformers-merge-experimentscircleci-test-resultsmarkdown-documentation-transformers
Hugging Face Transformers documentation as markdown dataset
This dataset was created using Clipper.js. Clipper is a Node.js command line tool that allows you to easily clip content from web pages and convert it to Markdown. It uses Mozilla's Readability library and Turndown under the hood to parse web page content and convert it to Markdown.
This dataset can be used to create RAG applications, which want to use the transformers documentation.
Example document:… See the full description on the dataset page: https://huggingface.co/datasets/philschmid/markdown-documentation-transformers.reddit-title-body
Reddit (Title, Body)-Pairs
This dataset contains jsonl-Files about (title, body) pairs from Reddit. Each line is a JSON object of the following format:
{'title': 'The title of a thread', 'body': 'The longer body of the thread', 'subreddit': 'subreddit_name'}
The 2021 file contains submissions up until including 2021-06. Entries in the respective files are shuffled on a monthly basis.
The data has been filtered for:
Remove threads with an upvote_ratio < 0.5
Only include threads… See the full description on the dataset page: https://huggingface.co/datasets/sentence-transformers/reddit-title-body.codeparrot-train
CodeParrot Dataset
This is the train split of the CodeParrot dataset. It contains Python files used to train the code generation model in Chapter 10: Training Transformers from Scratch in the NLP with Transformers book. You can find the full code in the accompanying Github repository.
See the full dataset for more information.
codeparrot
CodeParrot 🦜 Dataset
What is it?
This is the full CodeParrot dataset. It contains Python files used to train the code generation model in Chapter 10: Training Transformers from Scratch in the NLP with Transformers book. You can find the full code in the accompanying Github repository.
Creation
It was created with the GitHub dataset available via Google's BigQuery. It contains approximately 22 million Python files and is 180 GB (50 GB compressed) big. The… See the full description on the dataset page: https://huggingface.co/datasets/transformersbook/codeparrot.transformers-coding-session-pi-traces
dacorvo/transformers-coding-session-pi-traces
pi coding-agent session traces produced by
agentcap runs. Each run
contributes one folder under data/<run_id>/; inside, one file per
session in pi's native export format.
The on-the-wire HTTP captures for these same runs live in
dacorvo/transformers-coding-session-captures.
Both belong to the
transformers-coding-session Collection
— join on run_id to align captures with traces.
CATH4.2wiki-en-passages-20210101
wiki-en-passages-20210101
This is a processed dump of the English Wikipedia from 2021-01-01. Each page has been splitted into paragraphs as they appear in the text. Lists, tables and headlines had been removed. In total it has 38,080,804 passages.
Further, each article contain meta-data on the number of languages this article exists in and on the number of views this article received over a 1 year period.
The articles are sorted from most popular (most languages available, most… See the full description on the dataset page: https://huggingface.co/datasets/vocab-transformers/wiki-en-passages-20210101.transformers-github-issuesCATH4.3transformersjs-performance-leaderboard-results-devtransformers-pr-triage
Transformers PR Triage
Structured maintainer-triage reviews for the latest 50 pull requests in huggingface/transformers, reviewed on 2026-03-19 and 2026-03-20.
This repo intentionally contains a single source of truth:
data/reviews.jsonl: one JSON object per reviewed PR
Older dataset artifacts from the previous export were removed so the repo now only reflects this batch.
Row schema
Each row includes:
The JSON object keys are ordered for fast scanning. Each row… See the full description on the dataset page: https://huggingface.co/datasets/andito/transformers-pr-triage.distilled_group_mcGatedLinearAttention_Transformers_Q_and_Adistilled_math_dpo_tracesdistilled_math_numinahallucination_detection_transformers
ToolACE Hallucination Dataset
This dataset was generated for the assignment Hallucination Detection in Tool Calling.
It is based on ToolACE tool-calling dialogues and uses a RAGTruth-style schema:
query: user question
context: tool output / grounding evidence
output: assistant final answer
hallucination_labels: character-level hallucination spans
Files:
File
Rows
Description
toolace_clean_ragtruth.jsonl
1347
clean ToolACE tool-use answers… See the full description on the dataset page: https://huggingface.co/datasets/HASSANI8046/hallucination_detection_transformers.transformersproblem-10-latest-model-transformers4.48.3test-replication-transformers4.47.0transformers-en-ko-aligned-docs
Transformers EN-KO Aligned Docs
This dataset package contains English-Korean aligned text pairs derived from the docs/source/en and docs/source/ko trees in huggingface/transformers.
Repository layout
data/: published dataset splits only
metadata/: filtering, blacklist, and build-status artifacts
docs/: agent harness and dataset construction notes
AGENTS.md: short Codex entry point for this dataset repo
Contents
data/train.jsonl: final training split with… See the full description on the dataset page: https://huggingface.co/datasets/jmj-minju/transformers-en-ko-aligned-docs.