domofon/reddit-pretrain-post
reddit-pretrain-post Same documents as domofon/reddit-pretrain-xml, private. The only difference is the wrapper tag: <post> instead of <doc>. <title>, <body>, and <meta> are unchanged. <post> <meta subreddit="changemyview" date="2026-08-01" /> <title>...</title> <body> ... </body> </post> <|endoftext|> <|endoftext|> is SmolLM2-1.7B eos (token id 0). Trainer reads text only. 3,713,744 documents, 8 data/train-*.jsonl.gz shards.
031