ReactiveAI/Beta-Pre-Train-Corpus
Reactive AI / Beta Pre-Train Corpus Pre-training corpus for RxT-Beta models, created from public & open datasets. Includes high-quality english and polish web crawl data, mathematic and scientific subsets, and code in different programming languages. 2k subsets are filtered for 1024-2048 tokens, except MegaMath Web Pro and GitHub Code subsets, that were filtered for 512-2048 tokens Subsets & original datasets FineWeb-Edu fineweb-edu-s100 (51.3M examples) - 50% of… See the full description on the dataset page: https://huggingface.co/datasets/ReactiveAI/Beta-Pre-Train-Corpus.
021k
../
train-00000-of-00113.parquetdownload
train-00001-of-00113.parquetdownload
train-00002-of-00113.parquetdownload
train-00003-of-00113.parquetdownload
train-00004-of-00113.parquetdownload
train-00005-of-00113.parquetdownload
train-00006-of-00113.parquetdownload
train-00007-of-00113.parquetdownload
train-00008-of-00113.parquetdownload
train-00009-of-00113.parquetdownload
train-00010-of-00113.parquetdownload
train-00011-of-00113.parquetdownload
train-00012-of-00113.parquetdownload
train-00013-of-00113.parquetdownload
train-00014-of-00113.parquetdownload
train-00015-of-00113.parquetdownload
train-00016-of-00113.parquetdownload
train-00017-of-00113.parquetdownload
train-00018-of-00113.parquetdownload
train-00019-of-00113.parquetdownload
train-00020-of-00113.parquetdownload
train-00021-of-00113.parquetdownload
train-00022-of-00113.parquetdownload
train-00023-of-00113.parquetdownload
train-00024-of-00113.parquetdownload
train-00025-of-00113.parquetdownload
train-00026-of-00113.parquetdownload
train-00027-of-00113.parquetdownload
train-00028-of-00113.parquetdownload
train-00029-of-00113.parquetdownload
train-00030-of-00113.parquetdownload
train-00031-of-00113.parquetdownload
train-00032-of-00113.parquetdownload
train-00033-of-00113.parquetdownload
train-00034-of-00113.parquetdownload
train-00035-of-00113.parquetdownload
train-00036-of-00113.parquetdownload
train-00037-of-00113.parquetdownload
train-00038-of-00113.parquetdownload
train-00039-of-00113.parquetdownload
train-00040-of-00113.parquetdownload
train-00041-of-00113.parquetdownload
train-00042-of-00113.parquetdownload
train-00043-of-00113.parquetdownload
train-00044-of-00113.parquetdownload
train-00045-of-00113.parquetdownload
train-00046-of-00113.parquetdownload
train-00047-of-00113.parquetdownload
train-00048-of-00113.parquetdownload
train-00049-of-00113.parquetdownload
train-00050-of-00113.parquetdownload
train-00051-of-00113.parquetdownload
train-00052-of-00113.parquetdownload
train-00053-of-00113.parquetdownload
train-00054-of-00113.parquetdownload
train-00055-of-00113.parquetdownload
train-00056-of-00113.parquetdownload
train-00057-of-00113.parquetdownload
train-00058-of-00113.parquetdownload
train-00059-of-00113.parquetdownload
train-00060-of-00113.parquetdownload
train-00061-of-00113.parquetdownload
train-00062-of-00113.parquetdownload
train-00063-of-00113.parquetdownload
train-00064-of-00113.parquetdownload
train-00065-of-00113.parquetdownload
train-00066-of-00113.parquetdownload
train-00067-of-00113.parquetdownload
train-00068-of-00113.parquetdownload
train-00069-of-00113.parquetdownload
train-00070-of-00113.parquetdownload
train-00071-of-00113.parquetdownload
train-00072-of-00113.parquetdownload
train-00073-of-00113.parquetdownload
train-00074-of-00113.parquetdownload
train-00075-of-00113.parquetdownload
train-00076-of-00113.parquetdownload
train-00077-of-00113.parquetdownload
train-00078-of-00113.parquetdownload
train-00079-of-00113.parquetdownload
train-00080-of-00113.parquetdownload
train-00081-of-00113.parquetdownload
train-00082-of-00113.parquetdownload
train-00083-of-00113.parquetdownload
train-00084-of-00113.parquetdownload
train-00085-of-00113.parquetdownload
train-00086-of-00113.parquetdownload
train-00087-of-00113.parquetdownload
train-00088-of-00113.parquetdownload
train-00089-of-00113.parquetdownload
train-00090-of-00113.parquetdownload
train-00091-of-00113.parquetdownload
train-00092-of-00113.parquetdownload
train-00093-of-00113.parquetdownload
train-00094-of-00113.parquetdownload
train-00095-of-00113.parquetdownload
train-00096-of-00113.parquetdownload
train-00097-of-00113.parquetdownload
train-00098-of-00113.parquetdownload
train-00099-of-00113.parquetdownload
train-00100-of-00113.parquetdownload
train-00101-of-00113.parquetdownload
train-00102-of-00113.parquetdownload
train-00103-of-00113.parquetdownload
train-00104-of-00113.parquetdownload
train-00105-of-00113.parquetdownload
train-00106-of-00113.parquetdownload
train-00107-of-00113.parquetdownload
train-00108-of-00113.parquetdownload
train-00109-of-00113.parquetdownload
train-00110-of-00113.parquetdownload
train-00111-of-00113.parquetdownload
train-00112-of-00113.parquetdownload