Datasetpublic

bjoernp/oscar2023_deduped_filtered_1.1

Oscar 2023_01 DE Deduplicated This is a filtered and deduplicated version of the german subset of the 23.01 OSCAR Corpus, a large, crawled, and processed text dataset curated by the OSCAR project (Open Super-large Crawled Aggregated coRpus). OSCAR 23.01 is the January 2023 version of the OSCAR Corpus based on the November/December 2022 dump of Common Crawl. While being quite similar to OSCAR 22.01, it contains several new features, including KenLM-based adult content detection… See the full description on the dataset page: https://huggingface.co/datasets/bjoernp/oscar2023_deduped_filtered_1.1.

sourceHugging Faceupdated 3y agoView on Hugging Face

3likes1.4kdownloads

settings

This repository belongs to bjoernp on Hugging Face.

CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.

nameoscar2023_deduped_filtered_1.1

visibilitypublic

licencenot set

gatedno

ownerbjoernp

Account settings