oscar-corpus/mOSCAR

More info can be found here: https://oscar-project.github.io/documentation/versions/mOSCAR/ Paper link: https://arxiv.org/abs/2406.08707 New features: Additional filtering steps were applied to remove toxic content (more details in the next version of the paper, coming soon). Spanish split is now complete. Face detection in images to blur them once downloaded (coordinates are reported on images of size 256 respecting aspect ratio). Additional language identification of the documents to… See the full description on the dataset page: https://huggingface.co/datasets/oscar-corpus/mOSCAR.