openlibrary
openlibrary_dump_2024-04-30
OpenLibrary Dump (2024-04-30)
This dataset contains the OpenLibrary dump of April 2024 converted to Parquet and DuckDB for easier querying.
Formats
Original GZIP dumps
The original GZIP dumps are available at data/dumps. The dumps are gzipped TSV files with the original OL JSON record contained in the fifth column of the TSV.
DuckDB
The authors, works and editions dumps were imported as tables into… See the full description on the dataset page: https://huggingface.co/datasets/storytracer/openlibrary_dump_2024-04-30.open-library
Open Library
The complete Open Library catalog in clean, analysis-ready Parquet. 150.0M+ records across 11 entity types, from ISBNs and author bios to reading logs and Wikidata links.
What is it?
Open Library is a complete snapshot of the Open Library database, an open project of the Internet Archive with the mission of creating "one web page for every book ever published." The catalog is community-edited and contains bibliographic records for millions of authors, works… See the full description on the dataset page: https://huggingface.co/datasets/open-index/open-library.openlibrary
📚 OpenLibrary Parquet Mirror
An up‑to‑date, stream‑ready mirror of the official OpenLibrary public data dumps, converted to snappy‑compressed Parquet.
Source: https://openlibrary.org/developers/dumps
💾 Repository organization
openlibrary/
├── authors/ # authors_0.parquet, authors_1.parquet, … (≈ 1-2 GB each)
├── editions/ # editions_0.parquet, editions_1.parquet, …
└── works/ # works_0.parquet, works_1.parquet, …
🏃 Quick start
from datasets import… See the full description on the dataset page: https://huggingface.co/datasets/sayshara/openlibrary.openlibrary-unified
Open Library Unified Dataset
Description
This dataset contains a unified view of Open Library data, transforming 79GB of raw, semi-structured data into a 3.65GB Parquet file that preserves relationships between books, authors, and editions.
Data Structure
The dataset contains over 50 million records with the following key fields:
edition_id: Unique identifier for book editions
edition_title: Title of the edition
isbn: ISBN identifier when available
publisher:… See the full description on the dataset page: https://huggingface.co/datasets/Deval025/openlibrary-unified.media-metadata-openlibrary-books
TigreGotico/media-metadata-openlibrary-books
Rich entity dataset scraped by metadatarr
scraper openlibrary_books.
Rows: 4,098,190
Fields
olid
title
subtitle
authors
author_key
first_publish_year
subjects
isbn_10
isbn_13
publisher
language
number_of_pages_median
ebook_access
has_fulltext
edition_count
cover_i
Source
Generated by scrapers/openlibrary_books.py. See the metadatarr repo for the full
pipeline and scraper source code.
open-library-books
Open Library Books Dataset
A curated dataset of 500 real books sourced from the
Goodbooks-10k collection,
with genre labels derived from community tags.
Dataset Structure
Column
Type
Description
title
string
Book title (series info removed)
author
string
Primary author name
genre
string
Inferred genre from community tags
year
int
Original publication year (0 = unknown)
description
string
Short auto-generated description
Splits… See the full description on the dataset page: https://huggingface.co/datasets/Sarthak1003/open-library-books.