Polygl0t/mc4-50k

mC4 (50K samples per language) Dataset Summary This is the multilingual version of the C4 dataset. We only keep 50,000 samples per language for all the 108 languages available. This is intended for educational and experimentation purposes. For the full dataset, please refer to the multilingual config of the allenai/c4 dataset. How do I download this? Using 🤗 Datasets from datasets import load_dataset # Portuguese only pt =… See the full description on the dataset page: https://huggingface.co/datasets/Polygl0t/mc4-50k.