delphi
Datasets
All datasets matching “delphi”storiesv0-tinystories-v2-clean-tokenizedv0 refers to our tokenization process, v2 refers to stories generated by GPT4 only
stories-tokenizeddelphi-blog-data
Delphi blog-post data
Plot-ready tables behind each figure in the Delphi scaling-ladder blog post. One config per figure. Rows of different kinds (IsoFLOP scatter, parabola fits, held-out validation runs, ...) share a flat table per config and are distinguished by a kind column; unused fields are null for that row.
from datasets import load_dataset
ds = load_dataset("marin-community/delphi-blog-data", "delphi-ladder", split="train")
ds.filter(lambda r: r["kind"] == "isoflop") #… See the full description on the dataset page: https://huggingface.co/datasets/marin-community/delphi-blog-data.delphi-1e23-25b-stageE-rl-eval-artifacts
delphi-1e23 (25B) Stage-E RL — raw evalchemy eval artifacts
Raw evalchemy (lm-eval v0.4.12) outputs for the delphi-1e23 25B Stage-E RL sweep (marin issue #6279).
For each of 5 models (SFT wc50m baseline + 4 RL cells D1–D4) and 2 tasks:
<TASK>_<MODEL>_results.json — aggregate metrics + full run config (accuracy for MATH500; exact_match flexible/strict for gsm8k).
<TASK>_<MODEL>_samples.jsonl — per-example: problem, gold, model_output, extracted answer, correctness.
MATH500 =… See the full description on the dataset page: https://huggingface.co/datasets/laion/delphi-1e23-25b-stageE-rl-eval-artifacts.v0-token-map