open-index/arctic
Arctic Shift Reddit Archive Every Reddit comment and submission since 2005, organized as monthly Parquet shards What is it? The full Reddit archive from Arctic Shift, converted to Parquet and hosted here for easy access. Covers every public subreddit from 2005-12 through 2026-02. Right now the archive has 15.7B items (12.9B comments, 2.8B submissions) in 1.3 TB of compressed Parquet. Comments and submissions are stored as separate datasets, split into monthly… See the full description on the dataset page: https://huggingface.co/datasets/open-index/arctic.
Add comments 2022-08 shards 320-323 (4 files, 155.0 MB)
Add comments 2022-08 shards 316-319 (4 files, 161.5 MB)
Add comments 2022-08 shards 312-315 (4 files, 166.0 MB)
Add submissions 2022-08 shards 044-047 (4 files, 179.3 MB)
Add comments 2022-08 shards 308-311 (4 files, 160.3 MB)
Add comments 2022-08 shards 304-307 (4 files, 156.8 MB)
Add comments 2022-08 shards 300-303 (4 files, 166.4 MB)
Add submissions 2022-08 shards 040-043 (4 files, 184.5 MB)
Add comments 2022-08 shards 296-299 (4 files, 172.8 MB)
Add comments 2022-08 shards 292-295 (4 files, 167.7 MB)
Add comments 2022-08 shards 288-291 (4 files, 160.2 MB)
Add submissions 2022-08 shards 036-039 (4 files, 184.6 MB)
Add comments 2022-08 shards 284-287 (4 files, 166.4 MB)
Add comments 2022-08 shards 280-283 (4 files, 173.8 MB)
Add comments 2022-08 shards 276-279 (4 files, 169.3 MB)
Add submissions 2022-08 shards 032-035 (4 files, 184.1 MB)
Add comments 2022-08 shards 272-275 (4 files, 162.2 MB)
Add comments 2022-08 shards 268-271 (4 files, 166.4 MB)
Add submissions 2022-08 shards 028-031 (4 files, 179.8 MB)
Add comments 2022-08 shards 264-267 (4 files, 173.7 MB)
Add comments 2022-08 shards 260-263 (4 files, 171.2 MB)
Add comments 2022-08 shards 256-259 (4 files, 163.9 MB)
Add submissions 2022-08 shards 024-027 (4 files, 184.2 MB)
Add comments 2022-08 shards 252-255 (4 files, 167.9 MB)
Add comments 2022-08 shards 248-251 (4 files, 173.1 MB)
Add comments 2022-08 shards 244-247 (4 files, 169.7 MB)
Add submissions 2022-08 shards 020-023 (4 files, 186.5 MB)
Add comments 2022-08 shards 240-243 (4 files, 162.9 MB)
Add comments 2022-08 shards 236-239 (4 files, 166.0 MB)
Add comments 2022-08 shards 232-235 (4 files, 174.4 MB)
Add submissions 2022-08 shards 016-019 (4 files, 183.3 MB)
Add comments 2022-08 shards 228-231 (4 files, 172.6 MB)
Add comments 2022-08 shards 224-227 (4 files, 163.7 MB)
Add submissions 2022-08 shards 012-015 (4 files, 175.8 MB)
Add comments 2022-08 shards 220-223 (4 files, 163.0 MB)
Add comments 2022-08 shards 216-219 (4 files, 167.8 MB)
Add comments 2022-08 shards 212-215 (4 files, 165.9 MB)
Add submissions 2022-08 shards 008-011 (4 files, 194.5 MB)
Add comments 2022-08 shards 208-211 (4 files, 158.5 MB)
Add comments 2022-08 shards 204-207 (4 files, 162.0 MB)
Add comments 2022-08 shards 200-203 (4 files, 164.2 MB)
Add submissions 2022-08 shards 004-007 (4 files, 195.7 MB)
Add comments 2022-08 shards 196-199 (4 files, 160.9 MB)
Add comments 2022-08 shards 192-195 (4 files, 155.5 MB)
Add submissions 2022-08 shards 000-003 (4 files, 197.8 MB)
Add comments 2022-08 shards 188-191 (4 files, 164.5 MB)
Add comments 2022-08 shards 184-187 (4 files, 169.4 MB)
Add comments 2022-08 shards 180-183 (4 files, 167.2 MB)
Add comments 2022-08 shards 176-179 (4 files, 160.7 MB)
Add comments 2022-08 shards 172-175 (4 files, 169.1 MB)