datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Japanese-Novels-23M
Japanese-Novels-23M
This dataset contains Japanese web novels that I collected personally.
Machine-Learning Use OnlyAccess is restricted to bona fide machine-learning–related purposes.To request access, please provide a detailed explanation of the specific tasks or applications for which you intend to use the dataset.
Total records: 23,212,809
Total characters: 80,846,120,027
Total tokens (Llama 4 tokenizer): 55,406,468,406 (55.4 B)
Chinese_interactive_novels_3k
中文互动小说结构化语料
This dataset contains uncleaned (!) 3534 structured Chinese interactive novels (中文互动小说), accounting for around 0.25B (gpt-3.5) tokens in total.
All contents are parsed from certain online sources.
Usage
This dataset can be potentially used for LLM training. But be aware that you'd better clean the data yourself to remove undesired low-quality contents.
Each novel is a dict structured as follows:
class Novel:
book_title: str
book_author: str… See the full description on the dataset page: https://huggingface.co/datasets/mrzjy/Chinese_interactive_novels_3k.swedish-novels-1800-1940
Swedish Novels 1800-1940
A corpus of Swedish literary novels and short story collections from 1800-1940, sourced from Litteraturbanken.
Dataset Description
This dataset contains over 1.1 million sentences from 350 Swedish literary works spanning 140 years of Swedish literature. The texts have been sentence-segmented and include metadata about authors, titles, and publication years.
Fields
text: The sentence text
author: Author name
title: Work title
year:… See the full description on the dataset page: https://huggingface.co/datasets/UppsalaNLP/swedish-novels-1800-1940.memo-canonical-novels
Dataset description
source_datasets:
The corpus was created and made available by Jens Bjerring-Hansen and Philip Diderichsen, Dorte Haltrup Hansen, June 2023, see: https://huggingface.co/datasets/MiMe-MeMo/Corpus-v1.1
- Here, we make a more accessible, annotated version available.
Additional tags:
CE Canon: Cultural/Educational Canon, referring to novels whose titles are included in the Cultural Canon, or whose author is included in the Educational Canon.
LEX Canon:… See the full description on the dataset page: https://huggingface.co/datasets/chcaa/memo-canonical-novels.novels-embeddings-dataset
Dataset Card for "novels-embeddings-dataset"
More Information needed