datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
chinese-classical-corpus
Chinese Classical Corpus
🔗 源码 & 构建脚本: github.com/gujilab/chinese-classical-corpus — 完整抽取 pipeline、14 个 Python 脚本、验证套件
🎯 配套评测基准: gujilab/chinese-classical-bench — 500 道题 × 5 任务，测 LLM 古典文献能力（题目均从本语料抽样）
中国古典文献结构化语料集，含完整十三经 + 说文解字 + 资治通鉴 + 二十四史前 15 部，以及 197 万条古译今/今译古/断句指令对。
全部 CC0 公有领域，可商用、可改用、无附加限制。
为什么做这个
中文（尤其文言文）常被说成"高密度优势"。本语料集 + 配套评测想把这个论点变成可验证的数字 —— 包括它在哪些场景成立、在哪些场景不成立。
Tokenizer 层面 —— 真成立
7 个主流 tokenizer 横评（tokenizer_study）：
DeepSeek-V3 /… See the full description on the dataset page: https://huggingface.co/datasets/gujilab/chinese-classical-corpus.chinese-classical-corpus
Chinese Classical Corpus
🔗 Source code & build scripts: github.com/zi6me/chinese-classical-corpus — full extraction pipeline, 14 Python scripts, validation suite.
中国古典文献结构化语料集，含完整十三经 + 说文解字 + 资治通鉴 + 二十四史前 15 部，以及 197 万条古译今/今译古/断句指令对。
全部 CC0 公有领域，可商用、可改用、无附加限制。
Quick Start
from datasets import load_dataset
# 源语料 (12,005 条章节级记录, 17.2M 字)
corpus = load_dataset("dzxr/chinese-classical-corpus", "corpus", split="train")
# 古译今 / 今译古 双向指令数据 (1,924,378 条)
translate =… See the full description on the dataset page: https://huggingface.co/datasets/flowerone/chinese-classical-corpus.greathangpt-classical-chinese
GreatHanGPT 古汉语数据集
数据集描述
这是一个用于训练古汉语大语言模型的数据集，包含从先秦到清初（1644-1722）的汉语文献。
数据来源
来源
内容
链接
chinese-poetry
唐诗宋词、楚辞、诗经、四书五经
GitHub
Werneror/Poetry
先秦到清末诗词，按朝代分
GitHub
CBETA
大正藏佛经
GitHub
数据规模
指标
数值
总记录数
2,400,939
总字符数
450,496,972
估计token数
~300M
时代分布
时代
记录数
字符数
占比
先秦
1,376
14,493,846
3.2%
汉魏
16,450
14,348,817
3.2%
隋唐
729,162
122,265,102
27.1%
两宋
728,569
97,907,260
21.7%… See the full description on the dataset page: https://huggingface.co/datasets/kenpusney/greathangpt-classical-chinese.Appreciation-of-Chinese-Classical-Poetry
Appreciation of Chinese Classical Poetry
Chinese classical poetry with paired metadata and five-aspect literary analyses for PoetryMTEB / MTEB-style evaluation and computational poetics research.
Poems are drawn from expert appreciation volumes (mainly Shanghai Lexicographical Publishing House dictionaries). The released analysis fields are LLM distillations (DeepSeek-V3.1) of those expert appreciation texts into five free-text facets. The original long-form appreciation prose… See the full description on the dataset page: https://huggingface.co/datasets/PoetryMTEB/Appreciation-of-Chinese-Classical-Poetry.classical-chinese-poetry-benchmark-70
English Readme see below
(README由Claude 3.5 Sonnet生成)
中国古诗词大模型评测基准
简介
这是一个专门用于评测大语言模型在中国古诗词理解和生成方面能力的基准测试集。该基准包含了一个多样化的测试数据集和完整的评测框架,可用于系统性地评估和比较不同模型在古诗词领域的表现。
数据集说明
数据集(poetry_benchmark.jsonl)包含70个测试样本,涵盖以下维度:
题型分布:
对联补全
诗句填空
诗词识别
提示词补全
首尾互补
难度等级:
简单(easy)
中等(medium)
困难(hard)
朝代覆盖:
先秦至近现代
包括唐、宋、元、明、清等重要朝代
评测维度
评测框架从以下维度对模型进行全面评估:
整体准确率
不同题型的表现
不同难度等级的表现
不同朝代诗词的掌握程度
评测结果
模型
blank_filling
couplet
find_poetry… See the full description on the dataset page: https://huggingface.co/datasets/happyme531/classical-chinese-poetry-benchmark-70.chinese-classical-bench
Chinese Classical Bench
中国古典语言能力评测基准 — 6 个任务 × 100 题 = 600 道，覆盖翻译、断句、字义、典故、续写填空、现代→文言压缩。
📊 在线排行榜: 🤗 Space — chinese-classical-bench-leaderboard
🔗 评测代码 & runner: github.com/gujilab/chinese-classical-bench — eval runner（OpenAI 兼容端点）、打分器、排行榜聚合脚本
📦 配套语料集: gujilab/chinese-classical-corpus (CC0 公有领域) — 题目均从该语料抽样生成
为什么做这个
中文（尤其文言文）常被说成"高密度优势"。这套基础设施（bench + corpus + 4 个论点实证实验）想把这个论点变成可验证的数字 —— 包括它在哪些场景成立、在哪些场景不成立。
Tokenizer 层面（实证）
7 个主流 tokenizer 横评（详见下方… See the full description on the dataset page: https://huggingface.co/datasets/gujilab/chinese-classical-bench.classical-chinese-punctuation
Classical Chinese Punctuation Restoration · 文言文断句·标点 💰 (Commercial Dataset)
This is a commercial dataset. A free 200-record sample is provided below
(sample.jsonl); the full 5.3M-pair corpus is available upon request.
📧 To license / purchase or request a quote, email wangeksy@gmail.com.
✅ Cleared for commercial use — built from public-domain classical works.
The task
Restore punctuation and sentence segmentation (句读) to unpunctuated Classical
Chinese — a… See the full description on the dataset page: https://huggingface.co/datasets/wangekxy/classical-chinese-punctuation.classical-chinese-variant-collation
Classical Chinese Variant Collation · 校勘 💰 (Commercial Dataset)
This is a commercial dataset. A free 50-work preview sample is provided
below (sample.jsonl, texts truncated); the full set with complete aligned
texts is available upon request.
📧 To license / purchase or request a quote, email wangeksy@gmail.com.
✅ Cleared for commercial use — both members are public-domain classical works.
What this is
A textual-criticism dataset: classical works that survive… See the full description on the dataset page: https://huggingface.co/datasets/wangekxy/classical-chinese-variant-collation.