wordingone/ember-corpus

Ember Corpus The off-device mirror of the Ember training corpus: what was acquired, what was admitted, and what was tokenized. It exists so that a single disk failure on the training host does not destroy the corpus and every token derived from it. Layout The top level is the stage of the pipeline, and every artifact sits at exactly one stage. path stage what it holds sources/ acquired each source as fetched, one directory per source, with its own… See the full description on the dataset page: https://huggingface.co/datasets/wordingone/ember-corpus.