datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
text_error_correction文本纠错的相关数据
chinese_text_correction
Dataset Card
中文真实场景文本纠错数据集，包括拼写纠错、语法纠错、校对数据。
Repository: shibing624/pycorrector
Dataset Summary
拼写纠错数据
lemon_*.tsv：各领域拼写纠错数据集，包括汽车、医疗、新闻、游戏等领域，来自 https://github.com/gingasan/lemon/tree/main/lemon_v2
ec_*.tsv：法律、医学、政府领域拼写纠错数据集，来自 https://github.com/aopolin-lv/ECSpell/tree/main/Data/domains_data
medical_csc.tsv ：医学领域拼写纠错数据集，来自 https://github.com/yzhihao/MCSCSet/tree/main/data/mcsc_benchmark_dataset… See the full description on the dataset page: https://huggingface.co/datasets/shibing624/chinese_text_correction.text_error_correction文本纠错的相关数据
SLT-Task1-Post-ASR-Text-Correction
Dataset Name: Pilot dataset for Multi-domain ASR corrections
Description
This dataset is a pilot version of a larger dataset for automatic speech recognition (ASR) corrections across multiple domains.
It contains paired hypotheses and corrected transcriptions for various ASR tasks consolidated from PeacefulData/HyPoradise-v0
Structure
Data Split
The dataset is divided into training and test splits:
Training Data: 281,082 entries
Approximately 6,255… See the full description on the dataset page: https://huggingface.co/datasets/GenSEC-LLM/SLT-Task1-Post-ASR-Text-Correction.ICDAR_2019_Competition_Post-OCR_Text_Correction
[!NOTE]
Dataset origin: https://zenodo.org/records/3515403
Corpus for the ICDAR2019 Competition on Post-OCR Text Correction (October 2019)
=> Website: http://l3i.univ-larochelle.fr/ICDAR2019PostOCR
Description:
The corpus accounts for 22M OCRed characters along with the corresponding Gold Standard (GS). The documents come from different digital collections available, among others, at the National Library of France (BnF) and the British Library (BL). The corresponding GS… See the full description on the dataset page: https://huggingface.co/datasets/FrancophonIA/ICDAR_2019_Competition_Post-OCR_Text_Correction.vn-text-correction-0001
Dataset Card for Vietnamese Text Correction Dataset
Dataset Description
This dataset contains Vietnamese text pairs for training and evaluating text correction models. Each example consists of an erroneous text and its corrected version, making it ideal for:
Grammar correction
Spelling correction
Text normalization
Language model fine-tuning
Dataset Summary
Language: Vietnamese (vi)
Format: Text correction pairs
Size: ~4.0M examples across… See the full description on the dataset page: https://huggingface.co/datasets/LakoreAI/vn-text-correction-0001.text-correction_collection
Human Samples
These samples contains contains human-written sentences produced during language learning practice, combined with AI-based grammatical verification and correction. The original sentences were written by language learners who often did not know whether their sentences were correct or incorrect. These authentic learner inputs capture a wide range of natural mistakes, such as spelling, syntax, word choice, and structure errors.
Synthetic Samples
These… See the full description on the dataset page: https://huggingface.co/datasets/marcelone/text-correction_collection.text-correction-validationconstruct_text_correction
construct_text_correction
使用程序自动构造文本纠错数据集，包含拼写和语法纠错数据，可用于中文校对模型的训练。
Data Fields
Field
Type
Description
source
string
可能包含拼写/语法错误的源句子
target
string
纠错后的目标句子
label
int
源句子中是否包含错误，若为1，则包含错误，否则不包含错误。
{
"source": "健全国有林区经营管理体制，完散集体林权制度改革。",
"target": "健全国有林区经营管理体制，完善集体林权制度改革。",
"label": 1
}
Construction
安装 ltp:
pip install ltp ltp-core ltp-extension
生成 4k 条纠错句子对 4k.jsonl：
python finetune_data.py \
--input sentences/4k.txt \… See the full description on the dataset page: https://huggingface.co/datasets/WangZeJun/construct_text_correction.text-correction-enGroup_M_An_Annotated_Dataset_for_Hearing-Impaired_Speech-to-Text_Correction
Title
An Annotated Dataset for Hearing-Impaired Speech-to-Text Correction
Abstract
This dataset is specifically designed for the task of correcting speech to text errors in hearing-impaired individuals.
It includes one hour of real speech files of hearing-impaired individuals, automatic speech recognition (ASR) output text, and manually corrected standard text.
We searched for an hour of audio from hearing-impaired individuals to ensure that the voice was authentic and… See the full description on the dataset page: https://huggingface.co/datasets/llllliuuy/Group_M_An_Annotated_Dataset_for_Hearing-Impaired_Speech-to-Text_Correction.chinese_text_correction
Dataset Card
中文真实场景文本纠错数据集，包括拼写纠错、语法纠错、校对数据。
Repository: shibing624/pycorrector
Dataset Summary
拼写纠错数据
lemon_*.tsv：各领域拼写纠错数据集，包括汽车、医疗、新闻、游戏等领域，来自 https://github.com/gingasan/lemon/tree/main/lemon_v2
ec_*.tsv：法律、医学、政府领域拼写纠错数据集，来自 https://github.com/aopolin-lv/ECSpell/tree/main/Data/domains_data
medical_csc.tsv ：医学领域拼写纠错数据集，来自 https://github.com/yzhihao/MCSCSet/tree/main/data/mcsc_benchmark_dataset… See the full description on the dataset page: https://huggingface.co/datasets/xlp100/chinese_text_correction.wiki_text_correctiontranstrue_text_correctionTelugu_Text_Correctiontext-correctiontext_correction_finetuningrecognised_text_correctiontext_correction_vietnamese_documentationtext-correction-base