datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
PTT-pretrain-zhtw
Dataset Card for "yuhuanstudio/PTT-pretrain-zhtw"
資料集摘要
本資料集擷取自台灣最大的 BBS 討論區——批踢踢實業坊（PTT），匯集多個看板的歷史與近期討論，提供豐富的繁體中文語料，適用於大型語言模型（LLM）預訓練與自然語言處理（NLP）研究。
數據來源：PTT 批踢踢實業坊（https://www.ptt.cc）
涵蓋看板：包含 Gossiping、Tech_Job、Stock、NBA 等所有討論區
時間範圍：擷取自 PTT 公開存檔前200頁，涵蓋多年歷史數據 (因各版頁數問題，熱門版面資料可能時間都較為古老)
語言：繁體中文
資料格式：JSON，適合 LLM 訓練與 NLP 應用
資料規模：包含數十萬條貼文與回應
資料集結構
{
"text": "作者: Sonaten (=.=)\n看板: PC_Shopping\n標題: [閒聊] Gigabyte EP35-DS3 的DES...\n時間: Fri Jun 27 15:20:54 2008\n內文:… See the full description on the dataset page: https://huggingface.co/datasets/yuhuanstudio/PTT-pretrain-zhtw.PTT_en_ko
Parenthetical Terminology Translation (PTT) Dataset
Overview
The Parenthetical Terminology Translation (PTT) dataset is designed for evaluating and training models in translating technical terms while maintaining clarity and accuracy in specialized fields. It features English-Korean bilingual sentence pairs where the original English technical terms are displayed in parentheses alongside their Korean translations. The primary dataset covers the artificial intelligence… See the full description on the dataset page: https://huggingface.co/datasets/PrompTartLAB/PTT_en_ko.pt_text_completion
PT-PT Completions
Simple text-completion dataset to evaluete model bias towards European Portuguese (pt-PT) or Brazilian Portuguese (pt-BR).
This dataset is provided as part of the AMALIA project and is included in AMALIA-Bench, a comprehensive benchmark suite for evaluating large language models on European Portuguese.
Citation
If you use this dataset or AMALIA in your work, please cite:
@inproceedings{simplicio-etal-2026-amalia,
title =… See the full description on the dataset page: https://huggingface.co/datasets/amalia-llm/pt_text_completion.PTT_advanced_en_ko
Parenthetical Terminology Translation (PTT) Dataset
Overview
The Parenthetical Terminology Translation (PTT) dataset is designed for training language models on technical term translation, ensuring clarity and accuracy in specialized fields. This dataset consists of English-Korean bilingual sentence pairs, where the original English technical terms are displayed in parentheses alongside their Korean translations.
This dataset is an advanced version of PrompTart/PTT_en_ko… See the full description on the dataset page: https://huggingface.co/datasets/PrompTartLAB/PTT_advanced_en_ko.PTT-Corpus-100K_Gossiping-1400-39400_v2
版本資訊
增加了更多過濾詞並且一旦符合過濾規則，就會被過濾掉
簡介
本數據集使用來自PTT網站中的Gossiping分類的資料訓練總共爬取了第1400頁~第39400頁的所有文章裡的內容和所有留言在使用一些方法從海量的數據中，過濾出噪聲較小(理論上)的部份作為本數據集
過濾規則
總推數 - 總噓數 >= 20
最靠前的推文最優先
以下為過濾詞
#文章標題不能「包含」以下關鍵字
filter_title_in = ["http", "gif", "jpeg", "jpg", "png", "圖", "水桶", "永桶", "出桶", "被桶", "欠桶", "有效文章", "登入次數"]
#推文內容不能「等於」以下關鍵字
filter_content_equal = ["推", "推推", "推推推", "未看先推", "先推", "推一下", "推個", "正文", "頭", "錢", "好", "是", "引", "廢文"]
#推文內容不能「包含」以下關鍵字
filter_content_in =… See the full description on the dataset page: https://huggingface.co/datasets/Riyuechang/PTT-Corpus-100K_Gossiping-1400-39400_v2.asynchow-code-aligned-minutes
AsynChow Code-Aligned Minutes
This dataset is a unit-normalized variant of the AsynChow data released with
fangru-lin/procedure_generalization_llm,
pinned to source commit d9bf3485cd41c1050d33471d922c826f474efec1.
It contains three aligned representations of each weighted DAG scheduling
problem:
natural: natural-language steps and precedence constraints;
graph: adjacency-list and duration-dictionary representation;
python: executable-style Python representation from the… See the full description on the dataset page: https://huggingface.co/datasets/PTTREP/asynchow-code-aligned-minutes.ptt_c_chat_17400-17500PTT-Corpus-100K_Gossiping-1400-39400
簡介
本數據集使用來自PTT網站中的Gossiping分類的資料訓練總共爬取了第1400頁~第39400頁的所有文章裡的內容和所有留言在使用一些方法從海量的數據中，過濾出噪聲較小(理論上)的部份作為本數據集
過濾規則
總推數 - 總噓數 >= 20
最靠前的推文最優先
文章標題不能「包含」以下關鍵字，水桶
推文內容不能「等於」以下關鍵字，推、未看先推、先推、推推、推一下、推個、正文、頭香、水桶、頭、$、錢、好、是
推文內容不能「包含」以下關鍵字，頭香、水桶、樓上、樓下、一樓、二樓、三樓、四樓、五樓、六樓、七樓、八樓、九樓、1樓、2樓、3樓、4樓、5樓、6樓、7樓、8樓、9樓
並且為了節省VRAM空間，將question字數 + answer字數 > 50的數據丟棄
llama3_PttSurrogateMother_PTTPTT-RKG_Whisper_Fine-Tune