Datasetpublic

domofon/reddit-pretrain-post

reddit-pretrain-post Same documents as domofon/reddit-pretrain-xml, private. The only difference is the wrapper tag: <post> instead of <doc>. <title>, <body>, and <meta> are unchanged. <post> <meta subreddit="changemyview" date="2026-08-01" /> <title>...</title> <body> ... </body> </post> <|endoftext|> <|endoftext|> is SmolLM2-1.7B eos (token id 0). Trainer reads text only. 3,713,744 documents, 8 data/train-*.jsonl.gz shards.

sourceHugging Faceotherupdated 23d agoView on Hugging Face

0likes31downloads

Dataset Card

reddit-pretrain-post

Same documents as `domofon/reddit-pretrain-xml`, private. The only difference is the wrapper tag: <post> instead of <doc>. <title>, <body>, and <meta> are unchanged.

<post>
<meta subreddit="changemyview" date="2026-08-01" />
<title>...</title>
<body>
...
</body>
</post>
<|endoftext|>

<|endoftext|> is SmolLM2-1.7B eos (token id 0). Trainer reads text only. 3,713,744 documents, 8 data/train-*.jsonl.gz shards.