pairrm
Datasets
All datasets matching “pairrm”details_snorkelai__Snorkel-Mistral-PairRM-DPO
Dataset Card for Evaluation run of snorkelai/Snorkel-Mistral-PairRM-DPO
Dataset automatically created during the evaluation run of model snorkelai/Snorkel-Mistral-PairRM-DPO on the Open LLM Leaderboard.
The dataset is composed of 63 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_snorkelai__Snorkel-Mistral-PairRM-DPO.Snorkel-Mistral-PairRM-DPO-Dataset
Dataset:
This is the data used for training Snorkel model
We use ONLY the prompts from UltraFeedback; no external LLM responses used.
Methodology:
Generate 5 response variations for each prompt from a subset of 20,000 using the LLM - to start, we used Mistral-7B-Instruct-v0.2.
Apply PairRM for response reranking.
Update the LLM by applying Direct Preference Optimization (DPO) on the top (chosen) and bottom (rejected) responses.
Use this LLM as the base model for the next… See the full description on the dataset page: https://huggingface.co/datasets/snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset.details_ContextualAI__Contextual_KTO_Mistral_PairRM
Dataset Card for Evaluation run of ContextualAI/Contextual_KTO_Mistral_PairRM
Dataset automatically created during the evaluation run of model ContextualAI/Contextual_KTO_Mistral_PairRM on the Open LLM Leaderboard.
The dataset is composed of 63 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train"… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_ContextualAI__Contextual_KTO_Mistral_PairRM.details_Eric111__Snorkel-Mistral-PairRM-DPO-openchat-3.5-0106-laser
Dataset Card for Evaluation run of Eric111/Snorkel-Mistral-PairRM-DPO-openchat-3.5-0106-laser
Dataset automatically created during the evaluation run of model Eric111/Snorkel-Mistral-PairRM-DPO-openchat-3.5-0106-laser on the Open LLM Leaderboard.
The dataset is composed of 63 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_Eric111__Snorkel-Mistral-PairRM-DPO-openchat-3.5-0106-laser.ultrafeedback_binarized_dataset_offline_pairrm_part1
Dataset Card for "ultrafeedback_binarized_dataset_offline_pairrm_part1"
More Information needed
qwen3-8b_ultrafeedback_pairrm