datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
transformers-metadata
Transformers metadata
circleci-test-resultstransformers-merge-experimentspde-transformer-ape2dreddit-title-body
Reddit (Title, Body)-Pairs
This dataset contains jsonl-Files about (title, body) pairs from Reddit. Each line is a JSON object of the following format:
{'title': 'The title of a thread', 'body': 'The longer body of the thread', 'subreddit': 'subreddit_name'}
The 2021 file contains submissions up until including 2021-06. Entries in the respective files are shuffled on a monthly basis.
The data has been filtered for:
Remove threads with an upvote_ratio < 0.5
Only include threads… See the full description on the dataset page: https://huggingface.co/datasets/sentence-transformers/reddit-title-body.markdown-documentation-transformers
Hugging Face Transformers documentation as markdown dataset
This dataset was created using Clipper.js. Clipper is a Node.js command line tool that allows you to easily clip content from web pages and convert it to Markdown. It uses Mozilla's Readability library and Turndown under the hood to parse web page content and convert it to Markdown.
This dataset can be used to create RAG applications, which want to use the transformers documentation.
Example document:… See the full description on the dataset page: https://huggingface.co/datasets/philschmid/markdown-documentation-transformers.transformers-coding-session-pi-traces
dacorvo/transformers-coding-session-pi-traces
pi coding-agent session traces produced by
agentcap runs. Each run
contributes one folder under data/<run_id>/; inside, one file per
session in pi's native export format.
The on-the-wire HTTP captures for these same runs live in
dacorvo/transformers-coding-session-captures.
Both belong to the
transformers-coding-session Collection
— join on run_id to align captures with traces.
codeparrot-train
CodeParrot Dataset
This is the train split of the CodeParrot dataset. It contains Python files used to train the code generation model in Chapter 10: Training Transformers from Scratch in the NLP with Transformers book. You can find the full code in the accompanying Github repository.
See the full dataset for more information.
codeparrot
CodeParrot 🦜 Dataset
What is it?
This is the full CodeParrot dataset. It contains Python files used to train the code generation model in Chapter 10: Training Transformers from Scratch in the NLP with Transformers book. You can find the full code in the accompanying Github repository.
Creation
It was created with the GitHub dataset available via Google's BigQuery. It contains approximately 22 million Python files and is 180 GB (50 GB compressed) big. The… See the full description on the dataset page: https://huggingface.co/datasets/transformersbook/codeparrot.Reversi-Transformer-1-Selfplay
Reversi-Transformer Self-Play Dataset (m1)
This dataset contains self-play game records generated by Reversi-Transformer-1 playing against itself using MCTS, with C++ bitboard acceleration and multi-process shared-memory batched inference.
It provides 1.8 million board states formatted as TFRecords for training policy and value networks in Reversi AI.
Dataset Summary
Total Samples: ~1,796,729 board positions
Train: 15 TFRecord shards (1,619,475 samples)… See the full description on the dataset page: https://huggingface.co/datasets/rsu/Reversi-Transformer-1-Selfplay.CATH4.2wiki-en-passages-20210101
wiki-en-passages-20210101
This is a processed dump of the English Wikipedia from 2021-01-01. Each page has been splitted into paragraphs as they appear in the text. Lists, tables and headlines had been removed. In total it has 38,080,804 passages.
Further, each article contain meta-data on the number of languages this article exists in and on the number of views this article received over a 1 year period.
The articles are sorted from most popular (most languages available, most… See the full description on the dataset page: https://huggingface.co/datasets/vocab-transformers/wiki-en-passages-20210101.transformers-github-issuesCATH4.3GerAlpacaDataCleaned_transformer.wmt19.en-detransformer-hackathon-leaderboard
🏆 Transformer Hackathon Leaderboard
Build Your Own GPT • Train • Compete • Win!
📊 Current Standings
Lower perplexity = better model performance
Rank
Name
Team
Perplexity ⬇️
Loss
Tokens/sec
Timestamp
🥇
Kay sep
kay
1.9439
0.6647
67774
2026-02-07 21:29
🥈
Praneeth
Solo
1.9832
0.6847
91551
2026-02-07 21:35
🥉
James Faul, Vatsala
BA
1.9970
0.6917
149140
2026-02-07 20:18
4
ImageBear
Solo
1.9983
0.6923
67189
2026-02-07 20:10
5
Matt O
Solo
2.02160.7039
64286… See the full description on the dataset page: https://huggingface.co/datasets/abhisu30/transformer-hackathon-leaderboard.transformersjs-performance-leaderboard-results-devdistilled_group_mctransformers-pr-triage
Transformers PR Triage
Structured maintainer-triage reviews for the latest 50 pull requests in huggingface/transformers, reviewed on 2026-03-19 and 2026-03-20.
This repo intentionally contains a single source of truth:
data/reviews.jsonl: one JSON object per reviewed PR
Older dataset artifacts from the previous export were removed so the repo now only reflects this batch.
Row schema
Each row includes:
The JSON object keys are ordered for fast scanning. Each row… See the full description on the dataset page: https://huggingface.co/datasets/andito/transformers-pr-triage.distilled_math_dpo_tracesdistilled_math_numinainzynierka-transformer-100k
inzynierka-transformer-100k
100 000 presetów syntezatora, stokenizowane pod trening Transformer-VAE.
Rekordy leżą na gładkich i spójnych brzmieniowo trajektoriach w przestrzeni brzmienia, cel modelu to przestrzeń latentna,
po której da się organicznie ewoluować brzmienie z seeda w duchu Synplant2 od Sonic Charge.
Każdy fragment kodu który jest w tym README jest od codexa, żeby nakierować na poprawne uzycie tego repo, bo jest zagmatwane troche
tl;dr
100 000… See the full description on the dataset page: https://huggingface.co/datasets/Amourman/inzynierka-transformer-100k.GatedLinearAttention_Transformers_Q_and_Ahallucination_detection_transformers
ToolACE Hallucination Dataset
This dataset was generated for the assignment Hallucination Detection in Tool Calling.
It is based on ToolACE tool-calling dialogues and uses a RAGTruth-style schema:
query: user question
context: tool output / grounding evidence
output: assistant final answer
hallucination_labels: character-level hallucination spans
Files:
File
Rows
Description
toolace_clean_ragtruth.jsonl
1347
clean ToolACE tool-use answers… See the full description on the dataset page: https://huggingface.co/datasets/HASSANI8046/hallucination_detection_transformers.test-replication-transformers4.47.0transformersproblem-10-latest-model-transformers4.48.3Sentenced_transformer_paraphrased_NEWdiscrete_transformer_33_mechsdiscrete_transformer_17_mechs