JonasGeiping/the_pile_WordPiecex32768_8eb2d0ea9da707676c81314c4ea04507
Dataset Card for "the_pile_WordPiecex32768_8eb2d0ea9da707676c81314c4ea04507" Dataset Summary This is a preprocessed, tokenized dataset for the cramming-project. Use only with the tokenizer uploaded here. This version is 8eb2d0ea9da707676c81314c4ea04507, which corresponds to a specific dataset construction setup, described below. The raw data source is the Pile, a 825 GiB diverse, open source language modelling data set that consists of 22 smaller, high-quality… See the full description on the dataset page: https://huggingface.co/datasets/JonasGeiping/the_pile_WordPiecex32768_8eb2d0ea9da707676c81314c4ea04507.
Update README.md
Update README.md
Update README.md
Update README.md
Upload tokenizer/tokenizer_config.json with huggingface_hub
Upload tokenizer/tokenizer.json with huggingface_hub
Upload tokenizer/special_tokens_map.json with huggingface_hub
Upload README.md with huggingface_hub
Upload data/train-00076-of-00077-93863d1dd5b401e9.parquet with huggingface_hub
Upload data/train-00075-of-00077-f7adb36ff0c93b85.parquet with huggingface_hub
Upload data/train-00074-of-00077-860328583abab2fe.parquet with huggingface_hub
Upload data/train-00073-of-00077-ceb345d7a2ea4d10.parquet with huggingface_hub
Upload data/train-00072-of-00077-8b9a30534898643e.parquet with huggingface_hub
Upload data/train-00071-of-00077-e36f612721dd0ead.parquet with huggingface_hub
Upload data/train-00070-of-00077-78a2ffc389c0d459.parquet with huggingface_hub
Upload data/train-00069-of-00077-d5dda215aaca10a3.parquet with huggingface_hub
Upload data/train-00068-of-00077-7b0ec7671d160ec0.parquet with huggingface_hub
Upload data/train-00067-of-00077-1e98417b061a217b.parquet with huggingface_hub
Upload data/train-00066-of-00077-45c09b84538cc62c.parquet with huggingface_hub
Upload data/train-00065-of-00077-542232019e802bc5.parquet with huggingface_hub
Upload data/train-00064-of-00077-75a8da2b068aff16.parquet with huggingface_hub
Upload data/train-00063-of-00077-7cda815a37811a34.parquet with huggingface_hub
Upload data/train-00062-of-00077-e918a4c5f253f8e7.parquet with huggingface_hub
Upload data/train-00061-of-00077-f6a043aba49e2e1b.parquet with huggingface_hub
Upload data/train-00060-of-00077-ac59567fc6cbb0e8.parquet with huggingface_hub
Upload data/train-00059-of-00077-1f076fd4d1ebb9e5.parquet with huggingface_hub
Upload data/train-00058-of-00077-5a7ffc569d92793c.parquet with huggingface_hub
Upload data/train-00057-of-00077-d4de74a8419a4b69.parquet with huggingface_hub
Upload data/train-00056-of-00077-887c162b48709abc.parquet with huggingface_hub
Upload data/train-00055-of-00077-e3e82b3a809d0801.parquet with huggingface_hub
Upload data/train-00054-of-00077-0336746f714bfd90.parquet with huggingface_hub
Upload data/train-00053-of-00077-15daf9b38d848bc6.parquet with huggingface_hub
Upload data/train-00052-of-00077-f1bc5d19d3e50052.parquet with huggingface_hub
Upload data/train-00051-of-00077-f0d27e2341405b1e.parquet with huggingface_hub
Upload data/train-00050-of-00077-4c7c7cadb1eff1ec.parquet with huggingface_hub
Upload data/train-00049-of-00077-3e5bacda1e9cdb04.parquet with huggingface_hub
Upload data/train-00048-of-00077-6ccb3257a7692292.parquet with huggingface_hub
Upload data/train-00047-of-00077-f1647def32ecc785.parquet with huggingface_hub
Upload data/train-00046-of-00077-fbd86cb96b1b91be.parquet with huggingface_hub
Upload data/train-00045-of-00077-2d4f5b9f9f20ac2e.parquet with huggingface_hub
Upload data/train-00044-of-00077-4a90a42bc8d890bb.parquet with huggingface_hub
Upload data/train-00043-of-00077-e13049b615239aff.parquet with huggingface_hub
Upload data/train-00042-of-00077-3cd61faeb689ef79.parquet with huggingface_hub
Upload data/train-00041-of-00077-a3dc0bfe3d9ec679.parquet with huggingface_hub
Upload data/train-00040-of-00077-da97ac7550f42532.parquet with huggingface_hub
Upload data/train-00039-of-00077-8f27330095845063.parquet with huggingface_hub
Upload data/train-00038-of-00077-7825fd77d58469a4.parquet with huggingface_hub
Upload data/train-00037-of-00077-1ef2127543b91dfa.parquet with huggingface_hub
Upload data/train-00036-of-00077-bccdb6c9f306c827.parquet with huggingface_hub
Upload data/train-00035-of-00077-609e30f581bfffc6.parquet with huggingface_hub