Traditional Chinese
Traditional-Chinese-Common-Crawl-NOT-CleanedCommon Crawl Dumps that were briefly filtered by keywords to remove bad words and simplified Chinese.
The hash based cleaned dataset can be found here.
Files here are for future usage (downloading from Common Crawl and keyword filtering are very slow)
Traditional-Chinese-Common-Crawl-Filtered
Traditional Chinese C4
Dataset Summary
Data obtained from 2013～2025 Common Crawl.
Downloaded and processed using code based on another project attempting to recreate the C4 dataset.
The resultant dataset contains both simplified and traditional Chinese, which could be found here.
It was then filtered using a modified list of simplified Chinese characters to obtain this traditional Chinese dataset.
Unfortunately, I don't have enough funding to run a deduplication across… See the full description on the dataset page: https://huggingface.co/datasets/jed351/Traditional-Chinese-Common-Crawl-Filtered.IndustryCorpus2_medicine_health_psychology_traditional_chinese_medicine
IndustryCorpus2: Health & Medicine
This repository contains the IndustryCorpus2: Health & Medicine domain subset of BAAI/IndustryCorpus2.
Refer to the parent dataset card for data construction, intended use, limitations,
and licensing details.
Citation
If you use this dataset in your work, please cite IndustryCorpus2:
@misc{shi2024industrycorpus2,
title = {IndustryCorpus2},
author = {Xiaofeng Shi and Lulu Zhao and Hua Zhou and Donglin Hao},
year… See the full description on the dataset page: https://huggingface.co/datasets/BAAI/IndustryCorpus2_medicine_health_psychology_traditional_chinese_medicine.Traditional_Chinese-aya_collection
資料集描述
繁體中文 Aya (Traditional Chinese Aya Chinese;TCA)：專注於繁體中文處理的 Aya 集合的精選子集
概述
繁體中文 Aya 是一個精心策劃的資料集，源自 CohereForAI 的綜合 Aya 集合，特別關注繁體中文文本資料。
此資料集結合了來自 CohereForAI/aya_collection，過濾掉除繁體中文、簡體中文內容之外的所有內容。
目標
繁體中文 Aya 的目標是為研究人員、技術專家和語言學家提供即用型繁體中文文本資源，顯著減少專注於繁體中文的 NLP 和 AI 專案中數據預處理所需的時間和精力。
資料集來源與資訊
資料來源: 從 CohereForAI/aya_collection 64 個子集而來。
語言: 繁體中文、簡體中文（'zho')
應用: 非常適合語言建模、文本分類、情感分析、和機器翻譯等任務。
論文連結: 2402.06619
維護人: Heng666
License: Apache-2.0… See the full description on the dataset page: https://huggingface.co/datasets/Heng666/Traditional_Chinese-aya_collection.Traditional-Chinese-Medicine-Multiple_choice_question
Discription
This dataset is sourced from the website of the Ministry of Examination, R.O.C (Taiwan) and contains past exam questions from the national Traditional Chinese Medicine examinations in Taiwan. The exam comprises six subjects. This dataset specifically includes questions from two subjects, including the History of Traditional Chinese Medicine, Basic Theories of Traditional Chinese Medicine, Neijing, Nanjing, Traditional Chinese Medicine Prescription Studies, and… See the full description on the dataset page: https://huggingface.co/datasets/Liavan/Traditional-Chinese-Medicine-Multiple_choice_question.Traditional-Chinese-Medicine-Dataset-SFT
启古纳今，厚德精术
数据介绍
非网络来源的高质量中医数据集-指令微调
High-Quality Traditional Chinese Medicine Dataset from Non-Internet Sources - SFT/IFT
该数据集经过大量人力和资源的投入精心构建，以共建LLM高质量中文社区为己任。
包含约1GB的中医各个领域临床案例、名家典籍、医学百科，名词解释等优质问答内容，涵盖全面，配比均衡。
数据集主要由非网络来源的内部数据构成，并99%为简体中文内容，内容质量优异，信息密度可观。
该数据集的数据源与SylvanL/Traditional-Chinese-Medicine-Dataset-Pretrain中的内容存在一定关联，但不高度重叠。
在二者的构建过程中，存在着一定的循序渐进与互为补充的逻辑.
该数据集可以独立使用，但建议先使用配套的预训练数据集对模型进行继续预训练后，再使用该数据集进行进一步的指令微调。… See the full description on the dataset page: https://huggingface.co/datasets/SylvanL/Traditional-Chinese-Medicine-Dataset-SFT.