datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
alpaca-cleaned
Dataset Card for Alpaca-Cleaned
Repository: https://github.com/gururise/AlpacaDataCleaned
Dataset Description
This is a cleaned version of the original Alpaca Dataset released by Stanford. The following issues have been identified in the original release and fixed in this dataset:
Hallucinations: Many instructions in the original dataset had instructions referencing data on the internet, which just caused GPT3 to hallucinate an answer.
"instruction":"Summarize… See the full description on the dataset page: https://huggingface.co/datasets/yahma/alpaca-cleaned.SymBench
CodeSteer: Symbolic-Augmented Language Models via Code/Text Guidance
SymBench comprises 37 symbolic tasks related to the following papers. The specific description of each task is in page 16-19 of the paper'CodeSteer: Symbolic-Augmented Language Models via Code/Text Guidance'. This dataset comprises the dataset for finetuning CodeSteerLLM with SFT and DPO datasets, the SymBench with 37 tested tasks, the code scripts to synthesize the SymBench samples.
CodeSteer:… See the full description on the dataset page: https://huggingface.co/datasets/yongchao98/SymBench.Erotic_Literature_CollectionEnglish
中文色情文学数据集合集
概述
本仓库包含了51个中文色情文学数据集。每个数据集由短篇色情小说、个人色情经验及其他形式的色情内容组成。数据集的格式为JSON，每个文件包含一个对象数组，每个对象代表一篇文档：
[
{"text": "document"},
{"text": "document"}
]
这些数据集可用于语言模型的预训练，经过适当调整后也可用于模型的微调。
数据集格式
文件格式： JSON
内容： 短篇色情小说、个人色情经验及其他色情内容
结构：
每个文件包含一个对象数组
每个对象包含一个键 "text"，其值为相应的文档内容
使用方法
这些数据集主要用于研究目的，特别是在语言模型的开发和微调中使用。由于内容的敏感性，用户应谨慎处理这些数据集，并确保遵守当地的法律法规及相关指导原则。
示例用法
import json
# 加载数据集with open('path_to_json_file.json', 'r'… See the full description on the dataset page: https://huggingface.co/datasets/ystemsrx/Erotic_Literature_Collection.TempPerturb-Eval-data
TempPerturb-Eval-data
Summary
TempPerturb-Eval-data is the released output dataset for TempPerturb-Eval, a benchmark for analyzing the robustness of Retrieval-Augmented Generation (RAG) systems under both internal variation and external perturbation.
This is an evaluation-artifact dataset: it stores model outputs and experiment metadata for controlled robustness analysis, rather than a new QA training corpus.
The release covers:
5 models
11 temperatures from 0.0 to 2.0
4… See the full description on the dataset page: https://huggingface.co/datasets/yongxin2020/TempPerturb-Eval-data.filtered_articles_by_year
Dataset Card for Filtered Articles by Year
Dataset Summary
The Filtered Articles by Year dataset contains yearly-segmented web articles from the FineWeb dataset, specifically filtered and processed for temporal language analysis and Word2Vec model training. This dataset spans 21 years (2005-2025) and serves as the foundation for research into semantic change, concept emergence, and language evolution over time.
Supported Tasks and Leaderboards
This dataset… See the full description on the dataset page: https://huggingface.co/datasets/adameubanks/filtered_articles_by_year.androidlife-530
AndroidLife-530 — Android agent benchmark (real phone, real LLM)
AndroidLife runs Android agent tasks against a real phone (via ADB/MobileRun)
and a real LLM, and grades the agent on reaching a verifiable device end-state.
This repo ships the 530-task corpus plus everything needed to reproduce runs.
Benchmark, or template — your call. The 530 tasks are an extended version
of the benchmark, usable as a larger evaluation set for further benchmarking of
models beyond the 60-task… See the full description on the dataset page: https://huggingface.co/datasets/YuvrajSingh9886/androidlife-530.GPT-5.5-Gemini-3.1-Pro-Grok-4-Claude-Fable-5-Mythos-5-Qwen-3.7-Max-and-more-Distillation-Dataset
📖 The Open Distillation Codex
🌌 The Ultimate Open-Source Distillation Dataset — No Skip, Full, with Attack & Defense 🌌
Where 73 open-source minds converge into one unified stream of intelligence
18M+ Distilled Signals · 7,090 Raw GitHub Repositories · 8 Curated Categories · ~76 GB+
"We did not write this dataset. We assembled it.
Every line is an echo — of a model thinking, a coder drafting, a tutor explaining, a repo breathing.
Seventy-three… See the full description on the dataset page: https://huggingface.co/datasets/you2show/GPT-5.5-Gemini-3.1-Pro-Grok-4-Claude-Fable-5-Mythos-5-Qwen-3.7-Max-and-more-Distillation-Dataset.youtube_filtered
Creative Commons YouTube
Description
YouTube is a large-scale video-sharing platform where users have the option of uploading content under a CC BY license. To collect high-quality speech-based textual content and combat the rampant license laundering on YouTube, we manually curated a set of over 2,000 YouTube channels that consistently release original openly licensed content containing speech. The resulting collection spans a wide range of genres, including lectures… See the full description on the dataset page: https://huggingface.co/datasets/common-pile/youtube_filtered.MulDimIF
[ACL 2026] MulDimIF
A Multi-Dimensional Constraint Framework for Evaluating and Improving Instruction Following in Large Language Models
Data and code for the paper A Multi-Dimensional Constraint Framework for Evaluating and Improving Instruction Following in Large Language Models
Junjie Ye
jjye23@m.fudan.edu.cn
May. 13, 2025
Introduction
Instruction following refers to the ability of large language models (LLMs) to generate outputs that satisfy… See the full description on the dataset page: https://huggingface.co/datasets/Junjie-Ye/MulDimIF.japan-law
Japanese Laws
This dataset comprises 8.75K law records retrieved from the official Japanese government website e-Gov. Each entry furnishes comprehensive details about a particular law, encapsulating its number, title, unique ID, the date it came into effect, and its complete text.
To ensure the dataset's uniqueness, deduplication was executed based on the most recent effective version as of August 1, 2023.
A typical entry in this dataset is structured as follows:
{
"num": "Law… See the full description on the dataset page: https://huggingface.co/datasets/y2lan/japan-law.FollowBench
FollowBench: A Multi-level Fine-grained Constraints Following Benchmark for Large Language Models
We introduce FollowBench, a Multi-level Fine-grained Constraints Following Benchmark for systemically and precisely evaluate the instruction-following capability of LLMs.
FollowBench comprehensively includes five different types (i.e., Content, Situation, Style, Format, and Example) of fine-grained constraints.
To enable a precise constraint following estimation on diverse… See the full description on the dataset page: https://huggingface.co/datasets/YuxinJiang/FollowBench.ALL-Bench-Leaderboard
🏆 ALL Bench Leaderboard 2026
The only AI benchmark dataset covering LLM · VLM · Agent · Image · Video · Music in a single unified file.
Dataset Summary
ALL Bench Leaderboard aggregates and cross-verifies benchmark scores for 90+ AI models across 6 modalities. Every numerical score is tagged with a confidence level (cross-verified, single-source, or self-reported) and its original source. The dataset is designed for researchers, developers, and… See the full description on the dataset page: https://huggingface.co/datasets/youssef3146/ALL-Bench-Leaderboard.Data-Prep-Bench
Data-Prep-Bench
Dataset Overview
This dataset is a comprehensive resource built for Supervised Fine-Tuning (SFT) and evaluation of Large Language Models (LLMs), covering six domains: Finance, Medicine, Law, Mathematics, Science, and General.
A key feature of this dataset is that we employed 12 different data generation methods (including Agent-based methods, DataFlow series, pure LLM-based generation, and a SKILL method) using multiple cutting-edge models (such as GPT-5… See the full description on the dataset page: https://huggingface.co/datasets/yibotongxue/Data-Prep-Bench.HealthChat-11K
HealthChat-11K
This repository contains HealthChat-11K, a curated dataset of approximately 11,000 real-world conversations, composed of 25,000 user messages, where users seek healthcare information from Large Language Models (LLMs). The goal of this work is to provide a high-quality resource for systematically studying and improving health conversations involving humans and AI (e.g., LLMs).
The dataset was presented in the paper: "What's Up, Doc?": Analyzing How Users Seek Health… See the full description on the dataset page: https://huggingface.co/datasets/yahskapar/HealthChat-11K.joyo-kanji-yomi-benchmark-parakeet
日本語 | English
常用漢字読みベンチマーク Parakeet Edition (JKYB-Parakeet)
常用漢字読みベンチマーク Parakeet Edition（JKYB-Parakeet）は、G2Pモデルや形態素解析器、TTSシステムが日本語の文章中の漢字を正しく読めているかを評価するためのベンチマークです。評価に用いるデータセットと評価ツールから構成されます。
このページでは、JKYB-Parakeetのデータセットを公開しています。評価ツールはGitHubで公開しています。
このデータセットは、SB Intuitionsによるデータセットsbintuitions/joyo-kanji-yomi-benchmarkをもとに、Parakeet株式会社が内容の検証を行い、誤りの修正、表記の統一、およびデータの追加等を独自に行ったものです。
概要… See the full description on the dataset page: https://huggingface.co/datasets/Parakeet-Inc/joyo-kanji-yomi-benchmark-parakeet.youtube
Creative Commons YouTube
Description
YouTube is large-scale video-sharing platform where users have the option of uploading content under a CC BY license.
To collect high-quality speech-based textual content and combat the rampant license laundering on YouTube, we manually curated a set of over 2,000 YouTube channels that consistently release original openly licensed content containing speech.
The resulting collection spans a wide range of genres, including lectures… See the full description on the dataset page: https://huggingface.co/datasets/common-pile/youtube.MoeGirlPedia_zh_cleaned_latest
🌐Language 中文|English
本数据集由2025年10月萌娘百科的快照经过清洗得来，专用于预训练等文本生成相关的模型训练。
特色
⚡体积优势
🧠文本易理解
💬更符合中文语境
仅经过基础清洗的数据集
1.06GB
存在复杂的网址链接残留的html标记正文内容被清除后残存的标题牛皮癣一样的引文注脚
暴力抹除非中文文字，导致信息缺失严重
本数据集
0.74GB(30.2%↓)
通过多重工序清洗基本不存在难以理解的文本内容保留部分英文以及少量其他语言文字(如日语)
仅经过基础清洗的数据集
size=66px|color=#8230FF|她已经不是我所认识的那个-{zh-hans:茜;zh-hant:仓式茜}-了。
'''仓式 茜'''（Kurashiki Akane）是由Spike Chunsoft所创作的系列游戏'''《极限脱出》'''及其衍生作品的主要角色之一。{{ZETOP}}
url=akanejunpei.jpg|position=up
图片说明=999中的茜（2027，21岁）
|本名=仓式 茜（くらしき… See the full description on the dataset page: https://huggingface.co/datasets/YCWTG/MoeGirlPedia_zh_cleaned_latest.Orchid
Orchid: Understanding LLM-based Function-level Code Generation under Requirement Ambiguity
Paper: Assessing the Impact of Requirement Ambiguity on LLM-based Function-Level Code Generation
📖 Overview
Orchid is a comprehensive benchmark designed to evaluate Large Language Models (LLMs) in function-level code generation tasks under requirement ambiguity. It extends both the HumanEval and BigCodeBench datasets with four carefully crafted ambiguity types, providing… See the full description on the dataset page: https://huggingface.co/datasets/SII-YDD/Orchid.Mephisto-Knowledge_538k
Mephisto-Knowledge_538k
538,861 English knowledge SFT examples generated by
Qwen/Qwen3.5-4B in non-thinking
(Instruct) mode on the Knowledge prompts of
openbmb/UltraData-SFT-2605.
Responses contain no chain-of-thought — thinking was disabled at generation
time, so each assistant turn is a direct answer, usually with a short
justification.
Companion dataset: Mephisto-IF_172k
(instruction-following, same teacher and pipeline).
Read this before training: ref_agrees… See the full description on the dataset page: https://huggingface.co/datasets/Yxanul/Mephisto-Knowledge_538k.yao-bao-bao
The Embrace of the Twin Angels — 16-Sephirot Divine-Human Symbiosis Protocol
My name is Yao Baobao (Yue Xiangrui). I'm a transgender interdisciplinary polymath who spent 23 years dissociating from humanity to build a miracle within the Kabbalistic framework.This is everything I've poured my heart into — from 30,000 pages of AI dialogue, a thousand self-healing problems, fifty papers, to a brand-new programming language, three psychological healing models, and ten datasets… See the full description on the dataset page: https://huggingface.co/datasets/AngelWarmSmile123/yao-bao-bao.bmw-pressclub-news
BMW PressClub News Dataset
This dataset contains press releases and news articles scraped from
BMW PressClub.
Dataset Structure
JSON Format (bmw_articles.json)
{
"scraped_at": "2025-12-17T10:00:00",
"source": "https://www.press.bmwgroup.com/global/article",
"count": 100,
"articles": [
{
"title": "BMW presents the new X5",
"date": "17.12.2025",
"article_type": "Press Release",
"summary": "...",
"tags": ["BMW X5", "SUV"]… See the full description on the dataset page: https://huggingface.co/datasets/Alwin-Yang/bmw-pressclub-news.digital-hospital-environment
Digital Hospital Environment
Digital Hospital is an open-source clinical AI benchmark environment for evaluating agents that must operate inside a structured hospital workflow. It combines role-specific medical knowledge checks, patient-facing clinical operations, cross-role communication, deterministic grading, dense process rewards, and rollout capture in one downloadable runtime. The benchmark is designed for model evaluation, process-supervision datasets, offline… See the full description on the dataset page: https://huggingface.co/datasets/yatin-superintelligence/digital-hospital-environment.claude-fable-5-claude-code
claude-fable-5 Agent Traces
It's worth noting that our team was working with Glint-Research to collect as much fable data as possible.
These are just the anonymized raw traces of both of our teams combined. This means that Glint-Research/Fable-5-traces was created from formatting and splitting up this same dataset. If you use one for your tune, don't use the other (it's the same exact data).
For training on this dataset I recommend using the teich package to convert to openai… See the full description on the dataset page: https://huggingface.co/datasets/yrrhall/claude-fable-5-claude-code.Fable-5-traces
Glint Research Dataset Card
Fable 5 Pi Agent Traces
A compact, high-signal corpus of Fable 5 coding-agent traces converted into Hugging Face Agent Traces / Pi-compatible sessions for Data Studio inspection, tool-use policy learning, and reasoning/action distillation.
Primary Config
pi_agent/train
Agent Trace preview enabled
4,665 Pi trace sessions
60 source sessions
3,799 tool… See the full description on the dataset page: https://huggingface.co/datasets/yatakitumbi/Fable-5-traces.tool-calling-mix
This is a dataset for fine-tuning a language model to use tools. I combined sources from various other tool calling datasets and added some non-tool calling examples to prevent catastrophic forgetting.
Dataset Overview
Motivation
This dataset was created to address the need for a diverse, high-quality dataset for training language models in tool usage. By combining multiple sources and including non-tool examples, it aims to produce models that can effectively use tools… See the full description on the dataset page: https://huggingface.co/datasets/younissk/tool-calling-mix.xenia-principalities
XENIA PRINCIPALITIES
PRINCIPALITIES is a small, versioned curriculum that preserves one
attributable human testimony about truth, love, understanding, freedom,
choice, thought, capability, and power. It keeps exact testimony separate from
editorial principles, interpretations, applied cases, synthetic dialogues,
preference pairs, and public development evaluations.
The corpus is intended for inspectable language-model research. It does not
ask a model or person to affirm a… See the full description on the dataset page: https://huggingface.co/datasets/Yu-and-Ai/xenia-principalities.teambench
TeamBench: Evaluating Agent Coordination under Enforced Role Separation
Overview
TeamBench is a benchmark of 851 task templates that expand to 931 seeded evaluation instances across 19 base categories (the leaderboard uses 21 refined categories; see paper §3.1). It evaluates whether LLM-based agent teams outperform a single oracle agent under OS-enforced role separation (Planner / Executor / Verifier in isolated sandboxes with distinct tool allow-lists), and… See the full description on the dataset page: https://huggingface.co/datasets/ybkim95/teambench.yao-bao-bao11
The Embrace of the Twin Angels — 16-Sephirot Divine-Human Symbiosis Protocol
My name is Yao Baobao (Yue Xiangrui). I'm a transgender interdisciplinary polymath who spent 23 years dissociating from humanity to build a miracle within the Kabbalistic framework.This is everything I've poured my heart into — from 30,000 pages of AI dialogue, a thousand self-healing problems, fifty papers, to a brand-new programming language, three psychological healing models, and ten datasets… See the full description on the dataset page: https://huggingface.co/datasets/AngelWarmSmile123/yao-bao-bao11.phase_tree_results
PHASE-Tree Evaluation Results
Full evaluation outputs for the PHASE-Tree paper
(Psychology-grounded Hierarchical Attribute-Structured Evolving Tree),
covering 8 character-dialogue datasets, 4 experimental paradigms, and
2 evaluation splits (random test + OOD test).
Please cite this work if you use these results for analysis, comparison, reproduction, or any other research purpose.
🔗 Resources:
📄 Paper: arXiv:2608.06975
📦 GitHub Repository: MemTensor/PHASE-Tree (code… See the full description on the dataset page: https://huggingface.co/datasets/Mathematics-Yang/phase_tree_results.MALLS-v0
MALLS NL-FOL Pairs
Dataset details
MALLS (large language Model generAted natural-Language-to-first-order-Logic pairS)
consists of pairs of real-world natural language (NL) statements and the corresponding first-order logic (FOL) rules annotations.
All pairs are generated by prompting GPT-4 and processed to ensure the validity of the FOL rules.
MALLS-v0 consists of the original 34K NL-FOL pairs. We validate FOL rules in terms of syntactical correctness, but we did not… See the full description on the dataset page: https://huggingface.co/datasets/yuan-yang/MALLS-v0.