mxxsc/zip2zip-plus-mixture-partitioned
Zip2Zip Plus Mixture Partitioned This dataset is a partitioned pretraining-data mixture built for zip2zip language-model pretraining. The mixture is byte-balanced across four top-level domains: Domain Source Target byte ratio General HuggingFaceFW/fineweb-edu, sample-100BT 50% Code bigcode/the-stack-dedup 20% Math HuggingFaceTB/finemath, finemath-3plus 10% Multilingual epfml/FineWeb2-HQ, 20 language subsets 20% The uploaded layout is partitioned by source… See the full description on the dataset page: https://huggingface.co/datasets/mxxsc/zip2zip-plus-mixture-partitioned.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face