CoolFace
Datasetpublic

Avinash99/en-lightnovels-clean

en-lightnovels-clean is a cleaned English light novel dataset built from Baka-Tsuki English project pages and recoverable linked English fan-translation sources. The dataset contains 146 series, 17773 chapters, and 7,604,221 line-level records organized from a series / volume / chapter corpus, with 391,097,448 characters, 68,001,661 words, and 89,528,649 tokens measured with the Qwen/Qwen3-8B tokenizer. The default Hugging Face dataset view uses one row per text line. The original hierarchical… See the full description on the dataset page: https://huggingface.co/datasets/Avinash99/en-lightnovels-clean.

sourceHugging Faceotherupdated 4mo agoView on Hugging Face
0likes296downloads
Dataset Card

en-lightnovels-clean is a cleaned English light novel dataset built from Baka-Tsuki English project pages and recoverable linked English fan-translation sources.

The dataset contains 146 series, 17773 chapters, and 7,604,221 line-level records organized from a series / volume / chapter corpus, with 391,097,448 characters, 68,001,661 words, and 89,528,649 tokens measured with the Qwen/Qwen3-8B tokenizer.

The default Hugging Face dataset view uses one row per text line. The original hierarchical text layout under novels/ is preserved alongside the standard train-*.parquet export.

The source texts were manually reviewed and additionally strict-cleaned to remove obvious wrong-language pages, placeholder pages, glossary pages, Wikipedia/archive/project pages, translator-note pages, duplicated entries, and other non-story material, while keeping in-book forewords, afterwords, author notes, and commentary when they belonged to the original volume.

Copyright and translation rights remain with the original rightsholders, publishers, and/or translators. This dataset should be treated as a restricted research dataset and should not be assumed to be freely redistributable or commercially reusable.

Avinash99/en-lightnovels-clean · CoolFace