Datasetpublic

olm/olm-CC-MAIN-2022-33-sampling-ratio-0.20

Dataset Card for OLM August 2022 Common Crawl Cleaned and deduplicated pretraining dataset, created with the OLM repo here from 20% of the August 2022 Common Crawl snapshot. Note: last_modified_timestamp was parsed from whatever a website returned in it's Last-Modified header; there are likely a small number of outliers that are incorrect, so we recommend removing the outliers before doing statistics with last_modified_timestamp.

sourceHugging Faceupdated 4y agoView on Hugging Face

1likes2.3kdownloads

settings

This repository belongs to olm on Hugging Face.

CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.

nameolm-CC-MAIN-2022-33-sampling-ratio-0.20

visibilitypublic

licencenot set

gatedno

ownerolm

Account settings