datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
gutenberg_english
Dataset Card for Project Gutenber - English Language eBooks
A collection of non-english language eBooks (48284 rows, 80%+ of all english language books available on the site) from the Project Gutenberg site with metadata removed.
Originally colected for https://github.com/LAION-AI/Open-Assistant (follows the OpenAssistant training format)
The METADATA column contains catalogue meta information on each book as a serialized JSON:
key
original column
language
-
text_id… See the full description on the dataset page: https://huggingface.co/datasets/sedthh/gutenberg_english.project_gutenberg
Dataset Card for "Project Gutenberg"
Project Gutenberg is a library of over 70,000 free eBooks, hosted at https://www.gutenberg.org/.
All examples correspond to a single book, and contain a header and a footer of a few lines (delimited by a *** Start of *** and *** End of *** tags).
Usage
from datasets import load_dataset
ds = load_dataset("manu/project_gutenberg", split="fr", streaming=True)
print(next(iter(ds)))
License
Full license is available here:… See the full description on the dataset page: https://huggingface.co/datasets/manu/project_gutenberg.1-sentence-level-gutenberg-en_arxiv_pubmed_sodaproject_gutenberg
Project Gutenberg
Description
Project Gutenberg is an online collection of over 75,000 digitized books available as plain text.
We use all books that are 1) English and 2) marked as in the Public Domain according to the provided metadata.
Additionally, we include any books that are part of the PG19 dataset, which only includes books that are over 100 years old.
Minimal preprocessing is applied to remove the Project Gutenberg header and footers, but many scanned books… See the full description on the dataset page: https://huggingface.co/datasets/common-pile/project_gutenberg.gutenberg-conversations
The Gutenberg Conversations Dataset
A comprehensive collection meticulously curated from the extensive library of Project Gutenberg. This dataset specifically focuses on conversational excerpts from a diverse range of literary works, spanning various genres and time periods. It is designed to support and advance research in natural language processing, conversational analysis, machine learning, and linguistics.
Each entry in the dataset represents a conversational excerpt… See the full description on the dataset page: https://huggingface.co/datasets/weaverlabs/gutenberg-conversations.gutenberg_spacy-ner
Dataset Card for "gutenberg_spacy-ner"
More Information needed
project_gutenberg_filtered
Project Gutenberg
Description
Project Gutenberg is an online collection of over 75,000 digitized books available as plain text.
We use all books that are 1) English and 2) marked as in the Public Domain according to the provided metadata.
Additionally, we include any books that are part of the PG19 dataset, which only includes books that are over 100 years old.
Minimal preprocessing is applied to remove the Project Gutenberg header and footers, but many scanned books… See the full description on the dataset page: https://huggingface.co/datasets/common-pile/project_gutenberg_filtered.Gutenberg-BookCorpus-Cleaned-Data-English
Gutenberg-BookCorpus-Cleaned-Data-English
This dataset is been cleaned and preprocessed using Gutenberg_English_Preprocessor class method (given below) from preference Kaggle dataset 75,000+ Gutenberg Books and Metadata 2025. This dataset is only specialisation for english contented with rights as "Public domain in the USA" hence you can free used it anywhere.
Following reference metadata of Gutenberg is also available and downloaded it using following CLI command below :-
pip… See the full description on the dataset page: https://huggingface.co/datasets/incredible45/Gutenberg-BookCorpus-Cleaned-Data-English.gutenberg-100
Gutenberg Sci-Fi Book Dataset Testing Sample
This dataset contains information about science fiction books. It’s designed for training AI models, research, or any other purpose related to natural language processing.
It contains just 100 books for quick download targetting CI use (34MB).
The original dataset it's derived from is https://huggingface.co/datasets/stevez80/Sci-Fi-Books-gutenberg
Data Format
The dataset is provided in CSV format. Each record represents a… See the full description on the dataset page: https://huggingface.co/datasets/stas/gutenberg-100.gutenberg-dpo-v0.1
Gutenberg DPO
Overview
This is a dataset meant to enhance novel writing capabilities of LLMs, by using public domain books from Project Gutenberg
Process
First, the each book is parsed, split into chapters, cleaned up from the original format (remove superfluous newlines, illustration tags, etc.).
Once we have chapters, an LLM is prompted with each chapter to create a synthetic prompt that would result in that chapter being written.
Each chapter has a summary… See the full description on the dataset page: https://huggingface.co/datasets/jondurbin/gutenberg-dpo-v0.1.Gutenberg
Dataset Card for "Gutenberg"
More Information needed
the_pile_books3_minus_gutenberg
Dataset Card for "the_pile_books3_minus_gutenberg"
More Information needed
minisoul-gutenberg-en_USproject_gutenberg
Artificial Relationships in Fiction (ARF)
Dataset Summary
Artificial Relationships in Fiction (ARF) is a synthetically annotated dataset for Relation Extraction (RE) in fiction, created from a curated selection of literary texts sourced from Project Gutenberg. The dataset captures the rich, implicit relationships within fictional narratives using a novel ontology and GPT-4o for annotation. ARF is the first large-scale RE resource designed specifically for literary texts… See the full description on the dataset page: https://huggingface.co/datasets/Despina/project_gutenberg.Tumbuka_Text_Corpus_Translated_Gutenberg
Tumbuka Text Corpus - Translated Gutenberg
Dataset Description
This dataset contains a large-scale collection of Tumbuka text, primarily consisting of machine-translated literary works from the Project Gutenberg library. It is designed to support Natural Language Processing (NLP) research for Tumbuka, a Bantu language spoken in Malawi, Zambia, and Tanzania.
Dataset Summary
Language: Tumbuka (tum)
Source: Project Gutenberg
Content: Translated… See the full description on the dataset page: https://huggingface.co/datasets/Mwanzau/Tumbuka_Text_Corpus_Translated_Gutenberg.gutenberg_setthe-project-gutenberg-open-audiobook-collection
Project Gutenberg Open Audiobook Collection
Source: https://marhamilresearch4.blob.core.windows.net/gutenberg-public/Website/browse.html
You will need to install librosa and soundfile to load this dataset
project_gutenberggutenberg_spacy-nergutenberg-english-train
Dataset Card for "gutenberg-english-train"
More Information needed
Sci-Fi-Books-gutenberg
Gutenberg Sci-Fi Book Dataset
This dataset contains information about science fiction books. It’s designed for training AI models, research, or any other purpose related to natural language processing.
Data Format
The dataset is provided in CSV format. Each record represents a book and includes the following fields:
ID: A unique identifier for the book.
Title: The title of the book.
Author: The author(s) of the book.
Text: The text content of the book (e.g., summary… See the full description on the dataset page: https://huggingface.co/datasets/stevez80/Sci-Fi-Books-gutenberg.gutenberg-poetry-corpus
Allison Parrish's Gutenberg Poetry Corpus
This corpus was originally published under the CC0 license by Allison Parrish. Please visit Allison's fantastic accompanying GitHub repository for usage inspiration as well as more information on how the data was mined, how to create your own version of the corpus, and examples of projects using it.
This dataset contains 3,085,117 lines of poetry from hundreds of Project Gutenberg books. Each line has a corresponding gutenberg_id (1191… See the full description on the dataset page: https://huggingface.co/datasets/biglam/gutenberg-poetry-corpus.gutenberg_clean_en
Dataset Card for Project Gutenberg Cleaned (English Only) Dataset
This dataset is a cleaned English-language subset of the Project Gutenberg Dataset manu/project_gutenberg, originally containing ~70,000 digitized books.
The original dataset includes multiple languages, duplicate entries, and boilerplate content, all of which were removed for practicality and cleaner downstream use.
This dataset containg 38.026 books.
Cleaning and Preprocessing
The following steps… See the full description on the dataset page: https://huggingface.co/datasets/nikolina-p/gutenberg_clean_en.gutenberg8k
Gutenberg 8K
This is a subset of the files available at 15000 Gutenberg Books
About Dataset
The Gutenberg dataset represents a corpus of over 15,000 book texts, their authors and titles. The data has been scraped from the Project Gutenberg website using a custom script to parse all bookshelves. The text download links for the books have been stored in the gutenberg_metadata.csv file, alongside their respective book's title, author and bookshelf (category). The download… See the full description on the dataset page: https://huggingface.co/datasets/Fhrozen/gutenberg8k.passages_gutenberg_popularpassages_gutenberg_unpopulargutenberg_english_split_1000Just split version of sedthh/gutenberg_english to have up to 1000 words per each row
gutenberg-english-textgutenberg_time
Dataset Card for the Gutenberg Time dataset
Dataset Summary
A clean data resource containing all explicit time references in a dataset of 52,183 novels whose full text is available via Project Gutenberg.
Supported Tasks and Leaderboards
[More Information Needed]
Languages
Time-of-the-day classification from excerpts.
Dataset Structure
Data Instances
{
"guten_id": 28999,
"hour_reference": 12,
"time_phrase": "midday"… See the full description on the dataset page: https://huggingface.co/datasets/community-datasets/gutenberg_time.1-sentence-level-gutenberg-en_arxiv_pubmed_soda
Dataset Card for "1-sentence-level-gutenberg-en_arxiv_pubmed_soda"
More Information needed