Avinash99/en-lightnovels-clean
en-lightnovels-clean is a cleaned English light novel dataset built from Baka-Tsuki English project pages and recoverable linked English fan-translation sources. The dataset contains 146 series, 17773 chapters, and 7,604,221 line-level records organized from a series / volume / chapter corpus, with 391,097,448 characters, 68,001,661 words, and 89,528,649 tokens measured with the Qwen/Qwen3-8B tokenizer. The default Hugging Face dataset view uses one row per text line. The original hierarchical… See the full description on the dataset page: https://huggingface.co/datasets/Avinash99/en-lightnovels-clean.
en-lightnovels-clean is a cleaned English light novel dataset built from Baka-Tsuki English project pages and recoverable linked English fan-translation sources.
The dataset contains 146 series, 17773 chapters, and 7,604,221 line-level records organized from a series / volume / chapter corpus, with 391,097,448 characters, 68,001,661 words, and 89,528,649 tokens measured with the Qwen/Qwen3-8B tokenizer.
The default Hugging Face dataset view uses one row per text line. The original hierarchical text layout under novels/ is preserved alongside the standard train-*.parquet export.
The source texts were manually reviewed and additionally strict-cleaned to remove obvious wrong-language pages, placeholder pages, glossary pages, Wikipedia/archive/project pages, translator-note pages, duplicated entries, and other non-story material, while keeping in-book forewords, afterwords, author notes, and commentary when they belonged to the original volume.
Copyright and translation rights remain with the original rightsholders, publishers, and/or translators. This dataset should be treated as a restricted research dataset and should not be assumed to be freely redistributable or commercially reusable.
