Datasetpublic

reapxdev/github-repo-scraper

GitHub Repo Scraper · Repositories, Stars, Topics & Languages Scrape GitHub repositories by language, topic, star count, license, organization, and pushed date window. Returns clean structured repo metrics and metadata without authentication. Rows in this dataset 2,481 Fields 27 Collector runs behind it 50 Most recent observation 2026-08-04 Browsable presentation https://reapx.dev/data/github-repo-scraper/ — 2,071 entity pages Run the collector yourself… See the full description on the dataset page: https://huggingface.co/datasets/reapxdev/github-repo-scraper.

sourceHugging Facecc-by-4.0updated 2mo agoView on Hugging Face

0likes41downloads

Dataset Card

reapX — public sources in, addressable records out

GitHub Repo Scraper · Repositories, Stars, Topics & Languages

Scrape GitHub repositories by language, topic, star count, license, organization, and pushed date window. Returns clean structured repo metrics and metadata without authentication.


Rows in this dataset	2,481
Fields	27
Collector runs behind it	50
Most recent observation	2026-08-04
Browsable presentation	https://reapx.dev/data/github-repo-scraper/ — 2,071 entity pages
Run the collector yourself	https://apify.com/reapx/github-repo-scraper

What this is

Every row here was returned by a real run of a public collector. Nothing is generated from a template over a keyword list: a row exists because a run observed it.

A browsable presentation of the subset that carries an addressable slug is published as 2,071 entity pages at https://reapx.dev/data/github-repo-scraper/, one page per entity. This dataset is the larger of the two — rows whose payload has no field that can address a page are here and are not published there.

Provenance

Each row carries _run_id and _dataset_id, naming the collector run that produced it, so any row can be traced back to the run that observed it. Rows observed by more than one run are deduplicated on content; 0 duplicate observations were collapsed.

Files

—github-repo-scraper.jsonl — one JSON object per row, the canonical form
—github-repo-scraper.csv — the same rows flattened; nested values are JSON-encoded within their cell so they round-trip
—dataset.json — schema.org Dataset metadata

Loading it

python

from datasets import load_dataset
ds = load_dataset("reapxdev/github-repo-scraper", split="train")

A sample of the published entities

—All sources: <https://reapx.dev/data/> · machine-readable index: <https://reapx.dev/llms.txt>
—The collector is a public Apify Actor; agents reach it through <https://mcp.apify.com>

Licence

Collected from public sources. This metadata and the published pages are CC BY 4.0; the underlying records remain under the terms of their originating source.