rocca/top-reddit-posts

The post-data-by-subreddit.tar file contains 5000 gzipped json files - one for each of the top 5000 subreddits (as roughly measured by subscriber count and comment activity). Each of those json files (e.g. askreddit.json) contains an array of the data for the top 1000 posts of all time. Notes: I stopped crawling a subreddit's top-posts list if I reached a batch that had a post with a score less than 5, so some subreddits won't have the full 1000 posts. No posts comments are included. Only the… See the full description on the dataset page: https://huggingface.co/datasets/rocca/top-reddit-posts.