datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
chinese-classical-corpus
Chinese Classical Corpus
🔗 源码 & 构建脚本: github.com/gujilab/chinese-classical-corpus — 完整抽取 pipeline、14 个 Python 脚本、验证套件
🎯 配套评测基准: gujilab/chinese-classical-bench — 500 道题 × 5 任务，测 LLM 古典文献能力（题目均从本语料抽样）
中国古典文献结构化语料集，含完整十三经 + 说文解字 + 资治通鉴 + 二十四史前 15 部，以及 197 万条古译今/今译古/断句指令对。
全部 CC0 公有领域，可商用、可改用、无附加限制。
为什么做这个
中文（尤其文言文）常被说成"高密度优势"。本语料集 + 配套评测想把这个论点变成可验证的数字 —— 包括它在哪些场景成立、在哪些场景不成立。
Tokenizer 层面 —— 真成立
7 个主流 tokenizer 横评（tokenizer_study）：
DeepSeek-V3 /… See the full description on the dataset page: https://huggingface.co/datasets/gujilab/chinese-classical-corpus.chinese-classical-corpus
Chinese Classical Corpus
🔗 Source code & build scripts: github.com/zi6me/chinese-classical-corpus — full extraction pipeline, 14 Python scripts, validation suite.
中国古典文献结构化语料集，含完整十三经 + 说文解字 + 资治通鉴 + 二十四史前 15 部，以及 197 万条古译今/今译古/断句指令对。
全部 CC0 公有领域，可商用、可改用、无附加限制。
Quick Start
from datasets import load_dataset
# 源语料 (12,005 条章节级记录, 17.2M 字)
corpus = load_dataset("dzxr/chinese-classical-corpus", "corpus", split="train")
# 古译今 / 今译古 双向指令数据 (1,924,378 条)
translate =… See the full description on the dataset page: https://huggingface.co/datasets/flowerone/chinese-classical-corpus.Classical-Chinese-Roleplay
文言文角色扮演
本数据集包含了579条文言文多轮对话（同时包含短指令）
这是一个奇奇怪怪的数据集，说它是文言文，其实只是看起来像文言文的白话文
数据集中存在一些过短的指令，可以根据情况剔除相应语料
训练此数据集可以让你的模型变得（看似）文采飞扬
至少能看起来有文笔，对吧？
chinese-classical-bench
Chinese Classical Bench
中国古典语言能力评测基准 — 6 个任务 × 100 题 = 600 道，覆盖翻译、断句、字义、典故、续写填空、现代→文言压缩。
📊 在线排行榜: 🤗 Space — chinese-classical-bench-leaderboard
🔗 评测代码 & runner: github.com/gujilab/chinese-classical-bench — eval runner（OpenAI 兼容端点）、打分器、排行榜聚合脚本
📦 配套语料集: gujilab/chinese-classical-corpus (CC0 公有领域) — 题目均从该语料抽样生成
为什么做这个
中文（尤其文言文）常被说成"高密度优势"。这套基础设施（bench + corpus + 4 个论点实证实验）想把这个论点变成可验证的数字 —— 包括它在哪些场景成立、在哪些场景不成立。
Tokenizer 层面（实证）
7 个主流 tokenizer 横评（详见下方… See the full description on the dataset page: https://huggingface.co/datasets/gujilab/chinese-classical-bench.classical-chinese-poetry-benchmark-70
English Readme see below
(README由Claude 3.5 Sonnet生成)
中国古诗词大模型评测基准
简介
这是一个专门用于评测大语言模型在中国古诗词理解和生成方面能力的基准测试集。该基准包含了一个多样化的测试数据集和完整的评测框架,可用于系统性地评估和比较不同模型在古诗词领域的表现。
数据集说明
数据集(poetry_benchmark.jsonl)包含70个测试样本,涵盖以下维度:
题型分布:
对联补全
诗句填空
诗词识别
提示词补全
首尾互补
难度等级:
简单(easy)
中等(medium)
困难(hard)
朝代覆盖:
先秦至近现代
包括唐、宋、元、明、清等重要朝代
评测维度
评测框架从以下维度对模型进行全面评估:
整体准确率
不同题型的表现
不同难度等级的表现
不同朝代诗词的掌握程度
评测结果
模型
blank_filling
couplet
find_poetry… See the full description on the dataset page: https://huggingface.co/datasets/happyme531/classical-chinese-poetry-benchmark-70.classical-chinese-punctuation
Classical Chinese Punctuation Restoration · 文言文断句·标点 💰 (Commercial Dataset)
This is a commercial dataset. A free 200-record sample is provided below
(sample.jsonl); the full 5.3M-pair corpus is available upon request.
📧 To license / purchase or request a quote, email wangeksy@gmail.com.
✅ Cleared for commercial use — built from public-domain classical works.
The task
Restore punctuation and sentence segmentation (句读) to unpunctuated Classical
Chinese — a… See the full description on the dataset page: https://huggingface.co/datasets/wangekxy/classical-chinese-punctuation.classical-chinese-variant-collation
Classical Chinese Variant Collation · 校勘 💰 (Commercial Dataset)
This is a commercial dataset. A free 50-work preview sample is provided
below (sample.jsonl, texts truncated); the full set with complete aligned
texts is available upon request.
📧 To license / purchase or request a quote, email wangeksy@gmail.com.
✅ Cleared for commercial use — both members are public-domain classical works.
What this is
A textual-criticism dataset: classical works that survive… See the full description on the dataset page: https://huggingface.co/datasets/wangekxy/classical-chinese-variant-collation.Modern-Chinese-to-Classical-ChineseClassical_Chineseclassical_chineseclassical-chinese-text-generationClassical-Chinese-Poetry-Songs
Classical Chinese Poetry Songs
Version 1.0 · Chinese poetry-to-song dataset · MIT License
This is the frozen dataset used in Classical Chinese Poetry Song Generation:
A Curated Dataset and Domain Adaptation (working manuscript title).
It contains synthetic songs with vocals and accompaniment, poetic lyrics,
audio-grounded captions, original generation descriptions, and work-level splits.
The upstream song model was identified by generation providers as Suno V6;
this label was… See the full description on the dataset page: https://huggingface.co/datasets/junhao1122/Classical-Chinese-Poetry-Songs.