yuchenxie/The-Obsidian

Pretraining set used to pretrain Arlow. Partially uploaded. New dataset uploaded. This dataset is deprecated. This dataset is a mixture of datasets coming from: Huggingface FineWeb Huggingface FineWeb 2 PleIAs Common Corpus Open Math Text TinyStories AutoMathText