datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Helpsteer-preference-standardHelpSteer-AIF
HelpSteer: Helpfulness SteerLM Dataset
HelpSteer is an open-source Helpfulness Dataset (CC-BY-4.0) that supports aligning models to become more helpful, factually correct and coherent, while being adjustable in terms of the complexity and verbosity of its responses.
HelpSteer: Multi-attribute Helpfulness Dataset for SteerLM
Disclaimer
This is only a subset created with distilabel to evaluate the first 1000 rows using AI Feedback (AIF) coming from GPT-4, only created for… See the full description on the dataset page: https://huggingface.co/datasets/alvarobartt/HelpSteer-AIF.HelpSteer2A reformatted version of nvidia/HelpSteer2 into both a multiturn config conversation and completion config config.
A v4 UUID doc_id is shared across the same document in each config, source, conversation, and completion.
helpsteer3-qwen35_annotated_humanHelpSteer-AIF-raw
HelpSteer: Helpfulness SteerLM Dataset
HelpSteer is an open-source Helpfulness Dataset (CC-BY-4.0) that supports aligning models to become more helpful, factually correct and coherent, while being adjustable in terms of the complexity and verbosity of its responses.
HelpSteer: Multi-attribute Helpfulness Dataset for SteerLM
Disclaimer
This is only a subset created with distilabel to evaluate the first 1000 rows using AI Feedback (AIF) coming from GPT-4, only created for… See the full description on the dataset page: https://huggingface.co/datasets/alvarobartt/HelpSteer-AIF-raw.HelpSteer2_labeled_task
Dataset Card for HelpSteer2_labeled_task
This dataset has been created with distilabel.
Dataset Summary
This dataset contains a pipeline.yaml which can be used to reproduce the pipeline that generated it in distilabel using the distilabel CLI:
distilabel pipeline run --config "https://huggingface.co/datasets/CharlieJi/HelpSteer2_labeled_task/raw/main/pipeline.yaml"
or explore the configuration:
distilabel pipeline info --config… See the full description on the dataset page: https://huggingface.co/datasets/CharlieJi/HelpSteer2_labeled_task.HelpSteerA reformatted version of nvidia/HelpSteer into both a multiturn config conversation and completion config config.
A v4 UUID doc_id is shared across the same document in each config, source, conversation, and completion.
HelpSteer2_with_intent
Dataset Card for HelpSteer2_with_intent
This dataset has been created with distilabel.
Dataset Summary
This dataset contains a pipeline.yaml which can be used to reproduce the pipeline that generated it in distilabel using the distilabel CLI:
distilabel pipeline run --config "https://huggingface.co/datasets/CharlieJi/HelpSteer2_with_intent/raw/main/pipeline.yaml"
or explore the configuration:
distilabel pipeline info --config… See the full description on the dataset page: https://huggingface.co/datasets/CharlieJi/HelpSteer2_with_intent.HelpSteer2_prometheus
Dataset Card for HelpSteer2_prometheus
This dataset has been created with distilabel.
Dataset Summary
This dataset contains a pipeline.yaml which can be used to reproduce the pipeline that generated it in distilabel using the distilabel CLI:
distilabel pipeline run --config "https://huggingface.co/datasets/CharlieJi/HelpSteer2_prometheus/raw/main/pipeline.yaml"
or explore the configuration:
distilabel pipeline info --config… See the full description on the dataset page: https://huggingface.co/datasets/CharlieJi/HelpSteer2_prometheus.ChatML-HelpSteernvidia/HelpSteer in ChatML format, ready to use in HuggingFace TRL's SFT Trainer.
Python code used for conversion:
from datasets import load_dataset
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("Felladrin/Llama-160M-Chat-v1")
dataset = load_dataset("nvidia/HelpSteer", split="train")
def format(columns):
prompt = columns["prompt"].strip()
response = columns["response"].strip()
messages = [
{
"role": "user"… See the full description on the dataset page: https://huggingface.co/datasets/Felladrin/ChatML-HelpSteer.helpsteer_combined
Dataset Card for "helpsteer_combined"
More Information needed
helpsteer2-binarized-granular-fullThis is the nvidia/Helpsteer2 training split binarized and sorted by length using the Llama3 tokenizer and categorized into multi- vs. single-turn subparts.
The 500 splits contain chosen responses between 500-1000 tokens, the 1000 split 1000+ tokens.A multi-turn example requires at least one pair of User and Assistant besides the main resposne to be categorized as such.If you don't care, there is a combined split, which includes everything just binarized, but note that ids are not the same… See the full description on the dataset page: https://huggingface.co/datasets/root-signals/helpsteer2-binarized-granular-full.helpsteer3-qwen35_annotated_humanHelpSteer2_pairhelpsteer2_tail_modeldep_q10DPO-HelpSteer
Dataset Card for DPO-HelpSteer
Reformatted from nvidia/HelpSteer dataset.
The LION-series are trained using an empirically optimized pipeline that consists of three stages: SFT, DPO, and online preference learning (online DPO). We find simple techniques such as sequence packing, loss masking in SFT, increasing the preference dataset size in DPO, and online DPO training can significantly improve the performance of language models. Our best models (the LION-series) exceed the… See the full description on the dataset page: https://huggingface.co/datasets/Columbia-NLP/DPO-HelpSteer.helpsteer2-binarized-granular-tinyThis is the nvidia/Helpsteer2 training split binarized and sorted by length using the Llama3 tokenizer and categorized into multi- vs. single-turn subparts.
The 500 splits contain chosen responses between 500-1000 tokens, the 1000 split 1000+ tokens.
A multi-turn example requires at least one pair of User and Assistant besides the main resposne to be categorized as such.
If you don't care, there is a combined split, which includes everything just binarized, but note that ids are not the same… See the full description on the dataset page: https://huggingface.co/datasets/root-signals/helpsteer2-binarized-granular-tiny.helpsteer2-helpfulness-preference
Citation
@misc{wang2024helpsteer2preferencecomplementingratingspreferences,
title={HelpSteer2-Preference: Complementing Ratings with Preferences},
author={Zhilin Wang and Alexander Bukharin and Olivier Delalleau and Daniel Egert and Gerald Shen and Jiaqi Zeng and Oleksii Kuchaiev and Yi Dong},
year={2024},
eprint={2410.01257},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/2410.01257},
}
@misc{wang2024helpsteer2… See the full description on the dataset page: https://huggingface.co/datasets/Jennny/helpsteer2-helpfulness-preference.HelpSteer2-binarizedHelpsteer-armpreprocessed-helpsteer2-train-10knvidia-HelpSteer2-HindiThis dataset contains Hindi translation of the two columns "prompt" and "response" of the orginal dataset nvidia/HelpSteer2. The translation are stored in the columns "prompt-translation-hi" and "response-translation-hi" along with all the orginal columns.
HelpSteer3helpsteer3_goldSkywork-Reward-V2-Llama-3.1-8B-10khelpsteer3v2_annotated_Skywork-Skywork-Reward-V2-Llama-3-1-8Bhelpsteer-DPO-annotated
Helpsteer-DPO–Annotated
📝 Overview
This dataset provides Magpie-annotated metadata for the original Helpsteer 2 preference corpus, including task category, difficulty, input quality, language, and independent preference reward scores.
It serves as one of the five foundational components used in the UltraMix curation pipeline.
🏆 This annotated release was created as part of our paper (2026)
“When Data Is the Algorithm: A Systematic Study and Curation of… See the full description on the dataset page: https://huggingface.co/datasets/aladinDJ/helpsteer-DPO-annotated.helpsteer3-qwen35_annotated_human_25pctHelpSteer2-koTranslated nvidia/HelpSteer2 using nayohan/llama3-instrucTrans-enko-8b.
This dataset is a raw translated dataset and contains repetitive sentences generated by the model, so it needs to be filtered.
@misc{wang2024helpsteer2,
title={HelpSteer2: Open-source dataset for training top-performing reward models},
author={Zhilin Wang and Yi Dong and Olivier Delalleau and Jiaqi Zeng and Gerald Shen and Daniel Egert and Jimmy J. Zhang and Makesh Narsimhan Sreedhar and Oleksii Kuchaiev}… See the full description on the dataset page: https://huggingface.co/datasets/nayohan/HelpSteer2-ko.helpsteer2-preference_comparisonhelpsteer2-correctness-preference
Citation
@misc{wang2024helpsteer2preferencecomplementingratingspreferences,
title={HelpSteer2-Preference: Complementing Ratings with Preferences},
author={Zhilin Wang and Alexander Bukharin and Olivier Delalleau and Daniel Egert and Gerald Shen and Jiaqi Zeng and Oleksii Kuchaiev and Yi Dong},
year={2024},
eprint={2410.01257},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/2410.01257},
}
@misc{wang2024helpsteer2… See the full description on the dataset page: https://huggingface.co/datasets/Jennny/helpsteer2-correctness-preference.