datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
hacker-news-rss
Hacker News RSS Feed Directory
TL;DR — We visited every unique domain ever posted to Hacker News, found
which ones publish RSS/Atom feeds, and packaged the results as monthly
parquet snapshots with rich metadata.
623,957 feeds discovered across 1,755,955 hosts,
spanning 232 months from 2006-10 to 2026-03.
Last updated: 2026-04-05T09:21:39Z
Why this exists
RSS is not dead — it's just hard to discover. The <link rel="alternate">
tag that points to a site's feed is… See the full description on the dataset page: https://huggingface.co/datasets/open-index/hacker-news-rss.hackernews-stories
A HackerNews Stories dataset
This dataset is based on nixiesearch/hackernews-comments dataset:
for each item of type=story we downloaded the target URL. Out of ~3.8M stories ~2.1M are still reachable.
each story HTML was parsed using trafilatura library
we store article text in markdown format along with all page-specific metadata.
Dataset stats
date coverage: xx.2006-09.2024, same as in upstream nixiesearch/hackernews-comments dataset
total scraped pages: 2150271… See the full description on the dataset page: https://huggingface.co/datasets/nixiesearch/hackernews-stories.