jhu-clsp/ettin-pretraining-data
Ettin Pre-training Data Phase 1 of 3: Diverse pre-training data mixture (1.7T tokens) used to train the Ettin model suite. This dataset contains the pre-training phase data used to train all Ettin encoder and decoder models. The data is provided in MDS format ready for use with Composer and the ModernBERT training repository. 📊 Data Composition Data Source Tokens (B) Percentage Description DCLM 837.2 49.1% High-quality web crawl data CC Head… See the full description on the dataset page: https://huggingface.co/datasets/jhu-clsp/ettin-pretraining-data.
Add task categories and tags to dataset card (#12)
Update README.md
Update README.md
Update README.md
Update README.md
Update README.md
Create README.md
Upload folder using huggingface_hub (#11)
Upload folder using huggingface_hub (#10)
Upload folder using huggingface_hub (#9)
Upload folder using huggingface_hub (#8)
Upload folder using huggingface_hub (#7)
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_6839-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_75058-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_35295-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_65379-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_46730-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_24136-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_29603-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_9905-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_5897-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_93001-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_39351-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_60844-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_7514-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_45775-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_96507-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_24305-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_62861-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_67385-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_96519-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_18260-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_87475-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_46751-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_37218-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_52741-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_20076-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_63359-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_34465-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_76457-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_54188-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_21949-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_32053-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_66390-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_49136-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_81184-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_88025-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_78963-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_8822-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub
Upload mlfoundations-dclm-baseline-1.0-parquet-sampled-v4/split_6481-tokenized-chunked-1024-512-128-backfill-nodups.jsonl.tar.gz with huggingface_hub