datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
3D-data-megatronpython-megatronmegatron-prof-data-v5c4-filter-megatronmegatron-prof-data-v5-logsmegatron-prof-data-v6oscar-filter-megatronmegatron-configs
Training model configurations
This directory records model architecture configurations used by training examples or imported from reference
experiments. These files preserve model structure and provenance; they do not automatically configure or launch a
Megatron Bridge training job.
Configurations
The H100 entries below are restricted to runs pinned in the
RSI-Index/ale-rsi-pre-training workspace.
Nominal Compute
Model
Parameters
Actual Tokens
Training GPUs… See the full description on the dataset page: https://huggingface.co/datasets/ZhuofengLi/megatron-configs.megatron-prof-data-v14megatron-prof-data-v9megatron-prof-datamegatron-prof-data-v7dolma3_dolmino_megatron_tokenize
Dolma 3 / Dolmino Megatron-LM indexed dataset
This repository contains immutable Megatron-LM indexed datasets (.bin and
.idx) produced from pinned Dolma 3 and Dolmino releases. It intentionally
contains no training checkpoints, experiment outputs, logs, or dataset caches.
The indexed payloads were derived from these pinned public datasets:
allenai/dolma3_mix-150B-1025@afa92bfb22366821c5e6cd427cdd036b34b713ef… See the full description on the dataset page: https://huggingface.co/datasets/Mr-Philo/dolma3_dolmino_megatron_tokenize.megatron-prof-data-v3megatron-prof-data-v4details_Eurdem__megatron_v4_4x7B
Dataset Card for Evaluation run of Eurdem/megatron_v4_4x7B
Dataset automatically created during the evaluation run of model Eurdem/megatron_v4_4x7B on the Open LLM Leaderboard.
The dataset is composed of 63 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_Eurdem__megatron_v4_4x7B.details_Eurdem__megatron_v3_2x7B
Dataset Card for Evaluation run of Eurdem/megatron_v3_2x7B
Dataset automatically created during the evaluation run of model Eurdem/megatron_v3_2x7B on the Open LLM Leaderboard.
The dataset is composed of 63 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_Eurdem__megatron_v3_2x7B.megatron-prof-data-v10lm-eval-results-Eurdem-megatron_2.1_MoE_2x7B-private
Dataset Card for Evaluation run of Eurdem/megatron_2.1_MoE_2x7B
Dataset automatically created during the evaluation run of model Eurdem/megatron_2.1_MoE_2x7B
The dataset is composed of 62 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.… See the full description on the dataset page: https://huggingface.co/datasets/nyu-dice-lab/lm-eval-results-Eurdem-megatron_2.1_MoE_2x7B-private.megatron-prof-data-v12details_KnutJaegersberg__megatron-GPT-2-345m-EvolInstruct
Dataset Card for Evaluation run of KnutJaegersberg/megatron-GPT-2-345m-EvolInstruct
Dataset Summary
Dataset automatically created during the evaluation run of model KnutJaegersberg/megatron-GPT-2-345m-EvolInstruct on the Open LLM Leaderboard.
The dataset is composed of 64 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_KnutJaegersberg__megatron-GPT-2-345m-EvolInstruct.qwen3-c4-megatron
qwen3-c4-megatron
Megatron-LM indexed dataset files for Qwen3 tokenizer preprocessing on the C4 corpus.
Directory layout
qwen3-c4-megatron/
├── README.md
├── metadata.json
├── manifest.sha256
└── data/
├── c4_full.bin
└── c4_full.idx
Files
data/c4_full.bin: Megatron-LM binary token data.
data/c4_full.idx: Megatron-LM index file for c4_full.bin.
metadata.json: Dataset metadata and preprocessing configuration.
manifest.sha256: SHA256… See the full description on the dataset page: https://huggingface.co/datasets/shenjiarun/qwen3-c4-megatron.details_Eurdem__megatron_2.1_MoE_2x7B
Dataset Card for Evaluation run of Eurdem/megatron_2.1_MoE_2x7B
Dataset automatically created during the evaluation run of model Eurdem/megatron_2.1_MoE_2x7B on the Open LLM Leaderboard.
The dataset is composed of 63 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_Eurdem__megatron_2.1_MoE_2x7B.megatron-dev-datasetThis dataset has been created for testing purposes only. The dataset has been created from the RedPajama 1T Sample dataset by tokenizing the C4 sample data.
Licenses:
C4 License
simplestories-8k-megatron📦 Megatron-LM/MegaDLMs Preprocessed Dataset
This dataset hosts the Megatron-LM/MegaDLMs preprocessed SimpleStories dataset using an 8k vocab BPE Tokenizer.
✅ What this contains
Preprocessed Megatron dataset files (e.g., .bin / .idx) ready for Megatron-LM/MegaDLMs training
BPE Tokenizer config files used to create the dataset
🔗 References
Fork with extra preprocessing utils for SimpleStories:
https://github.com/triloy8/MegaDLMs
Original MegaDLMs repo:… See the full description on the dataset page: https://huggingface.co/datasets/trixyL/simplestories-8k-megatron.details_Eurdem__megatron_v1
Dataset Card for Evaluation run of Eurdem/megatron_v1
Dataset automatically created during the evaluation run of model Eurdem/megatron_v1 on the Open LLM Leaderboard.
The dataset is composed of 63 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_Eurdem__megatron_v1.prithivMLmods__Megatron-Corpus-14B-Exp-details
Dataset Card for Evaluation run of prithivMLmods/Megatron-Corpus-14B-Exp
Dataset automatically created during the evaluation run of model prithivMLmods/Megatron-Corpus-14B-Exp
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/prithivMLmods__Megatron-Corpus-14B-Exp-details.details_KnutJaegersberg__megatron-gpt2-345m-evol_instruct_v2
Dataset Card for Evaluation run of KnutJaegersberg/megatron-gpt2-345m-evol_instruct_v2
Dataset Summary
Dataset automatically created during the evaluation run of model KnutJaegersberg/megatron-gpt2-345m-evol_instruct_v2 on the Open LLM Leaderboard.
The dataset is composed of 3 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_KnutJaegersberg__megatron-gpt2-345m-evol_instruct_v2.details_Eurdem__megatron_1.1_MoE_2x7B
Dataset Card for Evaluation run of Eurdem/megatron_1.1_MoE_2x7B
Dataset automatically created during the evaluation run of model Eurdem/megatron_1.1_MoE_2x7B on the Open LLM Leaderboard.
The dataset is composed of 63 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_Eurdem__megatron_1.1_MoE_2x7B.megatron_llm_tutorial