datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
rlhf_helpful_evalreview_helpfulness_prediction
Dataset Card for Review Helpfulness Prediction (RHP) Dataset
Dataset Summary
The success of e-commerce services is largely dependent on helpful reviews that aid customers in making informed purchasing decisions. However, some reviews may be spammy or biased, making it challenging to identify which ones are helpful. Current methods for identifying helpful reviews only focus on the review text, ignoring the importance of who posted the review and when it was posted.… See the full description on the dataset page: https://huggingface.co/datasets/tafseer-nayeem/review_helpfulness_prediction.helpfulness-safety-calibration-dpo-100k
Helpfulness-Safety Calibration DPO (100K)
100,000 DPO preference pairs for calibrating the helpfulness-safety tradeoff in language models. Each example contains a prompt, a chosen response (correct handling), and a rejected response (incorrect handling) — covering both over-refusal and under-refusal failure modes.
Motivation
Safety-trained models often swing between two failure modes:
Over-refusal: Refusing legitimate requests because they superficially resemble… See the full description on the dataset page: https://huggingface.co/datasets/stindardlogic/helpfulness-safety-calibration-dpo-100k.hh-rlhf-helpful-base-jahttps://github.com/anthropics/hh-rlhf の内容のうち、helpful-base内のchosenに記載されている英文をfuguMTで翻訳、うまく翻訳できていないものを除外、修正したものです。
dpo-general-helpfulness-15k
General Helpfulness DPO Pairs (15K)
DPO preference pairs for training LLMs to give specific, actionable, genuinely useful responses instead of generic, hedged, or platitudinous ones.
Motivation
The most common failure mode in production LLMs isn't hallucination — it's unhelpfulness: vague answers, excessive caveats, refusals where none are needed, and generic advice that could apply to anyone. This dataset trains models to be genuinely helpful by rewarding… See the full description on the dataset page: https://huggingface.co/datasets/stindardlogic/dpo-general-helpfulness-15k.hh-rlhf-helpful-and-harmlessInternal copy of https://huggingface.co/datasets/Anthropic/hh-rlhf.
hh_rlhf_helpful_cn_train
Note
some rm data from public dataset
format
{
"history": [
"query1", "answer1",
"query2", "answer2"
],
"prompt": "query",
"input": "input for query",
"output": [
"output rank1",
"output rank2",
"output rank3"
]
}
Thanks
beyond/rlhf-reward-single-round-trans_chinese :
dikw/hh_rlhf_cn
liyucheng/zhihu_rlhf_3k
ontocord__Llama_3.2_1b-autoredteam_helpfulness-train-details
Dataset Card for Evaluation run of ontocord/Llama_3.2_1b-autoredteam_helpfulness-train
Dataset automatically created during the evaluation run of model ontocord/Llama_3.2_1b-autoredteam_helpfulness-train
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/ontocord__Llama_3.2_1b-autoredteam_helpfulness-train-details.helpful_harmless_data_10khh_rlhf_helpful_cn_test
Note
some rm data from public dataset
format
{
"history": [
["query1", "answer1"],
["query2", "answer2"]
],
"prompt": "query",
"input": "input for query",
"output": [
"output rank1",
"output rank2",
"output rank3"
]
}
Thanks
beyond/rlhf-reward-single-round-trans_chinese :
dikw/hh_rlhf_cn
liyucheng/zhihu_rlhf_3k
HH-RLHF-Personal-Copy-Helpfulness-Firsthelpful_comparisonshh-rlhf-helpfulInternal copy of https://huggingface.co/datasets/Anthropic/hh-rlhf.
helpful_testontocord__RedPajama3b_v1-autoredteam_helpfulness-train-details
Dataset Card for Evaluation run of ontocord/RedPajama3b_v1-autoredteam_helpfulness-train
Dataset automatically created during the evaluation run of model ontocord/RedPajama3b_v1-autoredteam_helpfulness-train
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train"… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/ontocord__RedPajama3b_v1-autoredteam_helpfulness-train-details.hh-helpful-base-llama3-8b-margin-dpo-margin-logshelpful-randomHH-RLHF-Personal-Copy-Helpful-Online-Firsthh-helpful-base-qwen3-8b-margin-dpo-margin-logsHH-RLHF-Personal-Copy-2-Helpfulness-First