Datasetpublic

ReactiveAI/Beta-Pre-Train-Corpus

Reactive AI / Beta Pre-Train Corpus Pre-training corpus for RxT-Beta models, created from public & open datasets. Includes high-quality english and polish web crawl data, mathematic and scientific subsets, and code in different programming languages. 2k subsets are filtered for 1024-2048 tokens, except MegaMath Web Pro and GitHub Code subsets, that were filtered for 512-2048 tokens Subsets & original datasets FineWeb-Edu fineweb-edu-s100 (51.3M examples) - 50% of… See the full description on the dataset page: https://huggingface.co/datasets/ReactiveAI/Beta-Pre-Train-Corpus.

sourceHugging Faceupdated 7mo agoView on Hugging Face

0likes29kdownloads

settings

This repository belongs to ReactiveAI on Hugging Face.

CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.

nameBeta-Pre-Train-Corpus

visibilitypublic

licencenot set

gatedno

ownerReactiveAI

Account settings