olmoe
Datasets
All datasets matching “olmoe”OLMoE-mix-0924
OLMoE Mix (September 2024)
The following data mix was used to train OLMoE-1B-7B, a Mixture-of-Experts LLM with 1B active and 7B total parameters released in September 2024.
The base version of OLMoE-1B-7B can be found at this page, the SFT of OLMoE-1B-7B is available here, and a version combining SFT and DPO is available following this link.
Statistics
Subset
Tokens
Words
Bytes
Docs
DCLM Baseline 1.0
3.86 T
3.38 T16.7 T
2.95 B
Starcoder
101 B
63.9 B… See the full description on the dataset page: https://huggingface.co/datasets/allenai/OLMoE-mix-0924.olmoearth-paper-embeddings
OlmoEarth — Foundation-Model Embeddings for Paper Table 2
This dataset contains pre-extracted embeddings from 26 Earth-observation
foundation models evaluated on the 24 downstream tasks that make up
Table 2 of the OlmoEarth paper:
OlmoEarth: Stable Latent Image Modeling for Multimodal Earth Observation
AI2, 2025. arXiv:2511.13655.
For every supported (model, task) pair we ran the model's encoder over the
task's train / validation / test splits with the paper-best… See the full description on the dataset page: https://huggingface.co/datasets/allenai/olmoearth-paper-embeddings.olmoearth_pretrain_datasetThis is the pre-training dataset for training the OlmoEarth pre-trained remote sensing foundation models.
Documentation is on GitHub at https://github.com/allenai/olmoearth_pretrain/blob/main/docs/Pretraining-Dataset.md
The dataset is released under CC BY 4.0. It includes data from the following sources:
Sentinel-2 L2A imagery from the European Space Agency, available under the Copernicus Sentinel Data and Service Legal Notice
Sentinel-1 GRD IW vv+vh imagery from the European Space Agency… See the full description on the dataset page: https://huggingface.co/datasets/allenai/olmoearth_pretrain_dataset.olmoearth_lcc
OlmoEarth Land Cover Change (LCC) Dataset
This dataset contains point-based annotations of land cover change, used to
train the OlmoEarth LCC model (https://olmoearth-lcc.allen.ai). The model
detects recent land cover change from Sentinel-2 time series: it inputs a Sentinel-2
image time series with 16 quarterly images (to establish a historical baseline) and 4
recent biweekly images (to detect changes soon after they occur) and predicts, per pixel,
whether a land cover change… See the full description on the dataset page: https://huggingface.co/datasets/allenai/olmoearth_lcc.OLMoE-mix-0924
OLMoE Mix (September 2024)
The following data mix was used to train OLMoE-1B-7B, a Mixture-of-Experts LLM with 1B active and 7B total parameters released in September 2024.
The base version of OLMoE-1B-7B can be found at this page, the SFT of OLMoE-1B-7B is available here, and a version combining SFT and DPO is available following this link.
Statistics
Subset
Tokens
Words
Bytes
Docs
DCLM Baseline 1.0
3.86 T
3.38 T16.7 T
2.95 B
Starcoder
101 B
63.9 B… See the full description on the dataset page: https://huggingface.co/datasets/Zengying/OLMoE-mix-0924.power-plant-olmoearth-segmentation
OlmoEarth v1.2-ready power energy dataset
Derived cook 20260830T191500Z from pinned source 35da3d0549b16e15114ded1eb7df3f4a378e9b4f.
The branch uses no train/validation/test split. Every accepted row is tagged all.
Accepted imagery rows: 12453
Quality-unavailable rows: 1
Release mode: partial with documented quality-unavailable exclusions
Clearest-available quality fallbacks: 10
Sentinel-2 L2A: uint16 [12,1,128,128]
Band order: B02,B03,B04,B08,B05,B06,B07,B8A,B11,B12,B01,B09… See the full description on the dataset page: https://huggingface.co/datasets/sarkarghya/power-plant-olmoearth-segmentation.