novels
Datasets
All datasets matching “novels”cnen_novels
TODOs
Lấy:
vi_docln.net
cn_qidian.com
en_novelhall
Làm sạch data
Loại bỏ You can read the novel online free at novelhall.com
Crawl novel ranking from https://www.webnovel.com/ranking/novel/all_time/popular_rank
Lựa chọn novels để train theo ranking từ cao tới thấp
Notes:
_cn_pixiv-novel, _cn_sis-novel bỏ vì có nội dung 18+
_en_webnovel.com bỏ vì nội dung trùng với en_novelhall
Crawled… See the full description on the dataset page: https://huggingface.co/datasets/tiendung/cnen_novels.novels
TODOs
Lấy:
vi_docln.net
cn_qidian.com
en_novelhall
Crawl novel ranking from https://www.webnovel.com/ranking/novel/all_time/popular_rank (done)
Lựa chọn novels để train theo ranking từ cao tới thấp => bỏ vì chỉ lấy đc ranking của top 200 truyện
Tạm thời lọc theo độ dài text của novels (ưu tiên các novel dài)
Và loại bỏ You can read the novel online free at novelhall.com
=> Tìm kiếm và show mội lines có chứa keywords novelhall.com
Notes:
_cn_pixiv-novel… See the full description on the dataset page: https://huggingface.co/datasets/tiendung/novels.Chinese-H-NovelsUpdate 12/07/2024: convert to parquet to download easier.
Chinese 18+ novels corpus, use at your own risk, you and only you are responsible for every choice you make.
(͡ ° ͜ʖ ͡ °)
tags: socks, garter belt, foot fetish, ntr, netori.....
Thanks Moleys/Numeron for the dataset donation.
Japanese-Novels-23M
Japanese-Novels-23M
This dataset contains Japanese web novels that I collected personally.
Machine-Learning Use OnlyAccess is restricted to bona fide machine-learning–related purposes.To request access, please provide a detailed explanation of the specific tasks or applications for which you intend to use the dataset.
Total records: 23,212,809
Total characters: 80,846,120,027
Total tokens (Llama 4 tokenizer): 55,406,468,406 (55.4 B)
tsinghua_novels_zhtwgenerated-novels