olmo-2-13b
olmo2-13b-combined-outputspolitical_prompts_OLMo-2-1124-13B-Instruct_seed_44olmo-2-1124-13b-preference-mix-mechanicalolmo-2-1124-13b-preference-mix
OLMo 2 1124 13B Preference Mixture
Note that this collection is licensed under ODC-BY-1.0 license; different licenses apply to subsets of the data. Some portions of the dataset are non-commercial. We present the mixture as a research artifact.
This mix is made up of the following on-policy preference datasets generated using a synthetic data generation pipeline similar to Tulu
Reused prompts from the SFT mix (via ai2-adapt-dev/sft_v3.9_used_on_policy_po_olmo2_13b and… See the full description on the dataset page: https://huggingface.co/datasets/allenai/olmo-2-1124-13b-preference-mix.olmo-2-1124-13b-preference-mix-leetspeakpolitical_prompts_OLMo-2-1124-13B-Instruct_seed_42