datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
details_snorkelai__Snorkel-Mistral-PairRM-DPO
Dataset Card for Evaluation run of snorkelai/Snorkel-Mistral-PairRM-DPO
Dataset automatically created during the evaluation run of model snorkelai/Snorkel-Mistral-PairRM-DPO on the Open LLM Leaderboard.
The dataset is composed of 63 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_snorkelai__Snorkel-Mistral-PairRM-DPO.Snorkel-Mistral-PairRM-DPO-Dataset
Dataset:
This is the data used for training Snorkel model
We use ONLY the prompts from UltraFeedback; no external LLM responses used.
Methodology:
Generate 5 response variations for each prompt from a subset of 20,000 using the LLM - to start, we used Mistral-7B-Instruct-v0.2.
Apply PairRM for response reranking.
Update the LLM by applying Direct Preference Optimization (DPO) on the top (chosen) and bottom (rejected) responses.
Use this LLM as the base model for the next… See the full description on the dataset page: https://huggingface.co/datasets/snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset.details_ContextualAI__Contextual_KTO_Mistral_PairRM
Dataset Card for Evaluation run of ContextualAI/Contextual_KTO_Mistral_PairRM
Dataset automatically created during the evaluation run of model ContextualAI/Contextual_KTO_Mistral_PairRM on the Open LLM Leaderboard.
The dataset is composed of 63 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train"… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_ContextualAI__Contextual_KTO_Mistral_PairRM.details_Eric111__Snorkel-Mistral-PairRM-DPO-openchat-3.5-0106-laser
Dataset Card for Evaluation run of Eric111/Snorkel-Mistral-PairRM-DPO-openchat-3.5-0106-laser
Dataset automatically created during the evaluation run of model Eric111/Snorkel-Mistral-PairRM-DPO-openchat-3.5-0106-laser on the Open LLM Leaderboard.
The dataset is composed of 63 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_Eric111__Snorkel-Mistral-PairRM-DPO-openchat-3.5-0106-laser.ultrafeedback_binarized_dataset_offline_pairrm_part1
Dataset Card for "ultrafeedback_binarized_dataset_offline_pairrm_part1"
More Information needed
qwen3-8b_ultrafeedback_pairrmllama3-8b-instruct-on-policy-PairRMgranite38bit_pairrmgranite38bit_woalign_pairrmpairrm-preference-datasetPairwise preference dataset generated using Mistral + PairRM.
UCLA-AGI__Mistral7B-PairRM-SPPOUltraFeedback-for-vrpo-4answers-by-mistra-pairrm-preference-with-templateqwen3-4b-no-think_ultrafeedback_pairrmultrafeedback_binarized_dataset_offline_pairrm_part0
Dataset Card for "ultrafeedback_binarized_dataset_offline_pairrm_part0"
More Information needed
deepseek-llm-7b-chat_ultrafeedback_pairrmultrafeedback_binarized_dataset_offline_pairrm_part2
Dataset Card for "ultrafeedback_binarized_dataset_offline_pairrm_part2"
More Information needed
ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_3
Dataset Card for "ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_3"
More Information needed
a4_lima_pairrm_preference_dataUCLA-AGI__Mistral7B-PairRM-SPPO-Iter3-details
Dataset Card for Evaluation run of UCLA-AGI/Mistral7B-PairRM-SPPO-Iter3
Dataset automatically created during the evaluation run of model UCLA-AGI/Mistral7B-PairRM-SPPO-Iter3
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/UCLA-AGI__Mistral7B-PairRM-SPPO-Iter3-details.UCLA-AGI__Mistral7B-PairRM-SPPO-Iter2-details
Dataset Card for Evaluation run of UCLA-AGI/Mistral7B-PairRM-SPPO-Iter2
Dataset automatically created during the evaluation run of model UCLA-AGI/Mistral7B-PairRM-SPPO-Iter2
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/UCLA-AGI__Mistral7B-PairRM-SPPO-Iter2-details.details_UCLA-AGI__Mistral7B-PairRM-SPPO
Dataset Card for Evaluation run of UCLA-AGI/Mistral7B-PairRM-SPPO
Dataset automatically created during the evaluation run of model UCLA-AGI/Mistral7B-PairRM-SPPO.
The dataset is composed of 136 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An… See the full description on the dataset page: https://huggingface.co/datasets/OALL/details_UCLA-AGI__Mistral7B-PairRM-SPPO.SystemChat-1.1-Preferences-PairRMdetails_chujiezheng__Mistral7B-PairRM-SPPO-ExPO
Dataset Card for Evaluation run of chujiezheng/Mistral7B-PairRM-SPPO-ExPO
Dataset automatically created during the evaluation run of model chujiezheng/Mistral7B-PairRM-SPPO-ExPO.
The dataset is composed of 136 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the… See the full description on the dataset page: https://huggingface.co/datasets/OALL/details_chujiezheng__Mistral7B-PairRM-SPPO-ExPO.ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_2
Dataset Card for "ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_2"
More Information needed
gemma-3-12b-it_ultrafeedback_pairrmqwen3-4b-base_sft_no-think_ultrafeedback_pairrmultrafeedback_binarized_dataset_offline_pairrm_part1_mini_0
Dataset Card for "ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_0"
More Information needed
details_UCLA-AGI__Mistral7B-PairRM-SPPO-Iter3
Dataset Card for Evaluation run of UCLA-AGI/Mistral7B-PairRM-SPPO-Iter3
Dataset automatically created during the evaluation run of model UCLA-AGI/Mistral7B-PairRM-SPPO-Iter3.
The dataset is composed of 136 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest… See the full description on the dataset page: https://huggingface.co/datasets/OALL/details_UCLA-AGI__Mistral7B-PairRM-SPPO-Iter3.ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_1
Dataset Card for "ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_1"
More Information needed
hw4_pairRM