Datasetpublic

Mr-Philo/dolma3_dolmino_megatron_tokenize

Dolma 3 / Dolmino Megatron-LM indexed dataset This repository contains immutable Megatron-LM indexed datasets (.bin and .idx) produced from pinned Dolma 3 and Dolmino releases. It intentionally contains no training checkpoints, experiment outputs, logs, or dataset caches. The indexed payloads were derived from these pinned public datasets: allenai/dolma3_mix-150B-1025@afa92bfb22366821c5e6cd427cdd036b34b713ef… See the full description on the dataset page: https://huggingface.co/datasets/Mr-Philo/dolma3_dolmino_megatron_tokenize.

sourceHugging Faceodc-byupdated 27d agoView on Hugging Face

0likes196downloads

50 commits on main

85b9e2a27d ago

Upload dolmino_ingredient2/qwen35/dolmino_ingredient2_02/output_text_document.bin

Mr-Philo

53c43ee27d ago

Upload dolmino_ingredient2/qwen35/dolmino_ingredient2_03/output_text_document.bin

Mr-Philo

a69682827d ago

Upload dolmino_ingredient2/qwen35/dolmino_ingredient2_01/output_text_document.bin

Mr-Philo

c4cee1027d ago

Upload dolmino_ingredient2/qwen35/dolmino_ingredient2_00/output_text_document.bin

Mr-Philo

3552cb727d ago

Upload dolmino_ingredient1/qwen35/dolmino_ingredient1_02/output_text_document.bin

Mr-Philo

f5f40da27d ago

Upload dolmino_ingredient1/qwen35/dolmino_ingredient1_01/output_text_document.bin

Mr-Philo

5bf3a2427d ago

Upload dolmino_ingredient1/qwen35/dolmino_ingredient1_03/output_text_document.bin

Mr-Philo

0a13da827d ago

Upload dolmino_ingredient1/qwen35/dolmino_ingredient1_00/output_text_document.bin

Mr-Philo

4002b1327d ago

Upload dolma3/qwen35/dolma3_01/output_text_document.bin

Mr-Philo

15e132627d ago

Upload dolma3/qwen35/dolma3_05/output_text_document.bin

Mr-Philo

c7369c527d ago

Upload dolma3/qwen35/dolma3_00/output_text_document.bin

Mr-Philo

5c33e4f27d ago

Upload dolma3/qwen35/dolma3_03/output_text_document.bin

Mr-Philo

587394627d ago

Upload dolma3/qwen35/dolma3_06/output_text_document.bin

Mr-Philo

403f99427d ago

Upload dolma3/qwen35/dolma3_02/output_text_document.bin

Mr-Philo

cec3d4e27d ago

Upload dolma3/qwen35/dolma3_07/output_text_document.bin

Mr-Philo

c1033d127d ago

Upload dolma3/qwen35/dolma3_04/output_text_document.bin

Mr-Philo

c588ca527d ago

Upload dolmino_ingredient2/gla/dolmino_ingredient2_02/output_text_document.bin

Mr-Philo

8d5b67f27d ago

Upload dolmino_ingredient2/gla/dolmino_ingredient2_03/output_text_document.bin

Mr-Philo

764ce3a27d ago

Upload dolmino_ingredient2/gla/dolmino_ingredient2_00/output_text_document.bin

Mr-Philo

6f24e7e27d ago

Upload dolmino_ingredient2/gla/dolmino_ingredient2_01/output_text_document.bin

Mr-Philo

c494d1927d ago

Upload dolmino_ingredient1/gla/dolmino_ingredient1_02/output_text_document.bin

Mr-Philo

f549aba27d ago

Upload dolmino_ingredient1/gla/dolmino_ingredient1_01/output_text_document.bin

Mr-Philo

300bfb527d ago

Upload dolmino_ingredient1/gla/dolmino_ingredient1_03/output_text_document.bin

Mr-Philo

cc72cb427d ago

Upload dolmino_ingredient1/gla/dolmino_ingredient1_00/output_text_document.bin

Mr-Philo

69d77da27d ago

Upload dolma3/gla/dolma3_01/output_text_document.bin

Mr-Philo

8fc9ad927d ago

Upload dolma3/gla/dolma3_05/output_text_document.bin

Mr-Philo

a67e2cb27d ago

Upload dolma3/gla/dolma3_00/output_text_document.bin

Mr-Philo

28a704027d ago

Upload dolma3/gla/dolma3_03/output_text_document.bin

Mr-Philo

df747c327d ago

Upload dolma3/gla/dolma3_06/output_text_document.bin

Mr-Philo

03c346127d ago

Upload dolma3/gla/dolma3_02/output_text_document.bin

Mr-Philo

5409ae827d ago

Upload dolma3/gla/dolma3_07/output_text_document.bin

Mr-Philo

96bb29a27d ago

Upload dolmino_ingredient2/qwen35/dolmino_ingredient2_02/output_text_document.idx

Mr-Philo

fb8251727d ago

Upload dolmino_ingredient2/gla/dolmino_ingredient2_02/output_text_document.idx

Mr-Philo

d9de4a027d ago

Upload dolmino_ingredient2/qwen35/dolmino_ingredient2_01/output_text_document.idx

Mr-Philo

c0ec8f627d ago

Upload dolmino_ingredient2/gla/dolmino_ingredient2_01/output_text_document.idx

Mr-Philo

447a52d27d ago

Upload dolmino_ingredient2/qwen35/dolmino_ingredient2_03/output_text_document.idx

Mr-Philo

76e45d127d ago

Upload dolmino_ingredient2/gla/dolmino_ingredient2_03/output_text_document.idx

Mr-Philo

a1d2b6a27d ago

Upload dolmino_ingredient2/qwen35/dolmino_ingredient2_00/output_text_document.idx

Mr-Philo

4fd790b27d ago

Upload dolmino_ingredient2/gla/dolmino_ingredient2_00/output_text_document.idx

Mr-Philo

118359327d ago

Upload dolmino_ingredient1/qwen35/dolmino_ingredient1_02/output_text_document.idx

Mr-Philo

2486c4f27d ago

Upload dolmino_ingredient1/gla/dolmino_ingredient1_02/output_text_document.idx

Mr-Philo

74596c627d ago

Upload dolmino_ingredient1/qwen35/dolmino_ingredient1_03/output_text_document.idx

Mr-Philo

4482a4327d ago

Upload dolmino_ingredient1/gla/dolmino_ingredient1_03/output_text_document.idx

Mr-Philo

15828ce27d ago

Upload dolmino_ingredient1/qwen35/dolmino_ingredient1_00/output_text_document.idx

Mr-Philo

ab9574d27d ago

Upload dolmino_ingredient1/gla/dolmino_ingredient1_00/output_text_document.idx

Mr-Philo

3d2137127d ago

Upload dolmino_ingredient1/qwen35/dolmino_ingredient1_01/output_text_document.idx

Mr-Philo

2682b7027d ago

Upload dolmino_ingredient1/gla/dolmino_ingredient1_01/output_text_document.idx

Mr-Philo

8c140f927d ago

Upload dolma3/gla/dolma3_06/output_text_document.idx

Mr-Philo

409313027d ago

Upload dolma3/qwen35/dolma3_06/output_text_document.idx

Mr-Philo

c19d78327d ago

Upload dolma3/gla/dolma3_02/output_text_document.idx

Mr-Philo