Datasetpublic

zhqwqwq/NCPL-Pretraining-Logs

Pretraining logs collected from: Marin Project: https://github.com/marin-community/marin Step Law Project: https://github.com/step-law/steplaw Each example corresponds to one training run, including the training configuration and performance metrics (C4-en evaluation loss for Marin, and smoothed pretraining loss for StepLaw). Load the dataset from datasets import load_dataset marin = load_dataset("zhqwqwq/NCPL-Pretraining-Logs", "marin", split="train") steplaw =… See the full description on the dataset page: https://huggingface.co/datasets/zhqwqwq/NCPL-Pretraining-Logs.

sourceHugging Faceupdated 7mo agoView on Hugging Face

0likes24downloads

Dataset Card

Pretraining logs collected from:

—Marin Project: https://github.com/marin-community/marin
—Step Law Project: https://github.com/step-law/steplaw

Each example corresponds to one training run, including the training configuration and performance metrics (C4-en evaluation loss for Marin, and smoothed pretraining loss for StepLaw).

Load the dataset

python

from datasets import load_dataset

marin = load_dataset("zhqwqwq/NCPL-Pretraining-Logs", "marin", split="train")
steplaw = load_dataset("zhqwqwq/NCPL-Pretraining-Logs", "steplaw", split="train")

ds = {"marin": marin, "steplaw": steplaw}