CoolFace
Datasetpublic

reapxdev/lemmy-scraper

Lemmy Scraper · Communities, Posts, Comments & Instances Scrape Lemmy communities, posts, comments, and instance metadata across the Fediverse. Structured data export by instance domain, community name, and sort type. Rows in this dataset 2,692 Fields 32 Collector runs behind it 38 Most recent observation 2026-08-04 What this is Every row here was returned by a real run of a public collector. Nothing is generated from a template over a… See the full description on the dataset page: https://huggingface.co/datasets/reapxdev/lemmy-scraper.

sourceHugging Facecc-by-4.0updated 2mo agoView on Hugging Face
1likes23downloads
Dataset Card

reapX — public sources in, addressable records out

Lemmy Scraper · Communities, Posts, Comments & Instances

Scrape Lemmy communities, posts, comments, and instance metadata across the Fediverse. Structured data export by instance domain, community name, and sort type.

Rows in this dataset2,692
Fields32
Collector runs behind it38
Most recent observation2026-08-04

What this is

Every row here was returned by a real run of a public collector. Nothing is generated from a template over a keyword list: a row exists because a run observed it.

Provenance

Each row carries _run_id and _dataset_id, naming the collector run that produced it, so any row can be traced back to the run that observed it. Rows observed by more than one run are deduplicated on content; 8 duplicate observations were collapsed.

Files

  • —lemmy-scraper.jsonl — one JSON object per row, the canonical form
  • —lemmy-scraper.csv — the same rows flattened; nested values are JSON-encoded within their cell so they round-trip
  • —dataset.json — schema.org Dataset metadata

Loading it

python
from datasets import load_dataset
ds = load_dataset("reapxdev/lemmy-scraper", split="train")

Related

  • —All sources: <https://reapx.dev/data/> · machine-readable index: <https://reapx.dev/llms.txt>
  • —The collector is a public Apify Actor; agents reach it through <https://mcp.apify.com>

Licence

Collected from public sources. This metadata and the published pages are CC BY 4.0; the underlying records remain under the terms of their originating source.