data-pipelines
eryon-data-pipelines
ERYON Data Pipelines
Official ERYON ingestion and preprocessing repository.
Bucket storage: hf://buckets/Chucks90/eryon-datasets
This repo: Chucks90/eryon-data-pipelines
Storage Architecture
eryon-datasets/ (bucket)
├── raw/ ← raw DICOM / WSIs / genomics archives
├── interim/ ← converted PNGs, tiles, embeddings
├── checkpoints/
├── inference/
└── simulations/
eryon-data-pipelines/ (this repo)
├── scripts/ ← ingestion + preprocessing scripts… See the full description on the dataset page: https://huggingface.co/datasets/Chucks90/eryon-data-pipelines.meta-math-MetaMathQA_sample100microsoft-orca-agentinstruct-1M-v1_sample100