wordingone/ember-corpus
Ember Corpus The off-device mirror of the Ember training corpus: what was acquired, what was admitted, and what was tokenized. It exists so that a single disk failure on the training host does not destroy the corpus and every token derived from it. Layout The top level is the stage of the pipeline, and every artifact sits at exactly one stage. path stage what it holds sources/ acquired each source as fetched, one directory per source, with its own… See the full description on the dataset page: https://huggingface.co/datasets/wordingone/ember-corpus.
tier2: issue1581-arxiv-selected-fetch-20260909T2058Z part0001 (train)
tier2: issue1581-arxiv-selected-fetch-20260909T2058Z part0000 (train)
tier2: J-train-2 part0000 (train)
tier2: J-heldout-1 part0000 (heldout)
tier2: issue2071-pdf-remint-current-v2-20260903T0129Z part0000 (train)
tier2: issue2071-pdf-authority-cascade-3dbc1197-20260903T0312Z part0000 (train)
tier2: issue1719-tranche9r-postmerge-a3ac-20260819T1028Z part0000 (train)
tier2: issue1719-tranche9r-closed-table-premerge-20260819T0954Z part0000 (train)
tier2: issue1719-tranche9-plan-20260818T2216Z part0000 (train)
tier2: issue1719-tranche9-b-train1-20260818T2216Z part0000 (train)
tier2: issue1719-tranche8-k-train-20260818T1641Z part0000 (train)
tier2: issue1719-tranche7-b-heldout-20260818T1052Z part0000 (heldout)
tier2: issue1719-tranche6-pdf-20260818T0958Z part0000 (train)
tier2: issue1719-tranche5-gate5-20260818T074515Z part0000 (train)
tier2: issue1719-tranche4d-corrected-20260818T074313Z part0000 (train)
tier2: issue1719-tranche4d-admission-20260818T0305Z part0000 (train)
tier2: issue1719-tranche4c-admission-20260818T0109Z part0000 (train)
tier2: issue1719-tranche4b-admission-20260818T0052Z part0000 (train)
tier2: issue1719-tranche4a-admission-20260817T2324Z part0000 (train)
tier2: issue1719-tranche3r-relocation-preview-20260817T2158Z part0000 (train)
tier2: issue1719-tranche3r-preview-20260817T2135Z part0000 (train)
tier2: issue1719-tranche3r-preview-20260817T2129Z part0000 (train)
tier2: issue1719-tranche3r-preview-20260817T2126Z part0000 (train)
tier2: issue1719-tranche3r-merged-bfc394a-20260817T2224Z part0000 (train)
tier2: issue1719-tranche3-admission-20260817T2102Z part0000 (train)
tier2: issue1719-tranche2-admission-20260817T1842Z part0000 (train)
tier2: issue1719-tranche10-projected-4a0a-20260821T010059Z part0000 (train)
tier2: issue1719-tranche10-postmerge-a3ac-20260819T1821Z part0000 (train)
tier2: issue1719-tranche1-admission-20260817T1830Z part0000 (train)
tier2: issue1719-real-predecessor-reopen-proof-20260818T0236Z part0000 (train)
tier2: issue1719-nonarxiv-wave-20260819T0034Z part0003 (train)
tier2: issue1719-nonarxiv-wave-20260819T0034Z part0002 (train)
tier2: issue1719-nonarxiv-wave-20260819T0034Z part0001 (train)
tier2: issue1719-nonarxiv-wave-20260819T0034Z part0000 (train)
tier2: issue1719-k-heldout1-v2-transform-20260819T0140Z part0000 (heldout)
tier2: issue1719-k-heldout1-v2-sidecar-20260819T0153Z part0000 (heldout)
tier2: issue1719-k-heldout1-v2-fetch-20260818T1721Z part0000 (heldout)
tier2: issue1719-k-heldout1-v2-adapter-20260819T0156Z part0000 (heldout)
tier2: issue1719-floor-wave-20260818T025422Z part0004 (train)
tier2: issue1719-floor-wave-20260818T025422Z part0003 (train)
tier2: issue1719-floor-wave-20260818T025422Z part0002 (train)
tier2: issue1719-floor-wave-20260818T025422Z part0001 (train)
tier2: issue1719-floor-wave-20260818T025422Z part0000 (train)
tier2: issue1719-evidence-batch2-dclm-20260818T0015Z part0017 (train)
tier2: issue1719-evidence-batch2-dclm-20260818T0015Z part0016 (train)
tier2: issue1719-evidence-batch2-dclm-20260818T0015Z part0015 (train)
tier2: issue1719-evidence-batch2-dclm-20260818T0015Z part0014 (train)
tier2: issue1719-evidence-batch2-dclm-20260818T0015Z part0013 (train)
tier2: issue1719-evidence-batch2-dclm-20260818T0015Z part0012 (train)
tier2: issue1719-evidence-batch2-dclm-20260818T0015Z part0011 (train)