datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Snorkel-Mistral-PairRM-DPO-Dataset
Dataset:
This is the data used for training Snorkel model
We use ONLY the prompts from UltraFeedback; no external LLM responses used.
Methodology:
Generate 5 response variations for each prompt from a subset of 20,000 using the LLM - to start, we used Mistral-7B-Instruct-v0.2.
Apply PairRM for response reranking.
Update the LLM by applying Direct Preference Optimization (DPO) on the top (chosen) and bottom (rejected) responses.
Use this LLM as the base model for the next… See the full description on the dataset page: https://huggingface.co/datasets/snorkelai/Snorkel-Mistral-PairRM-DPO-Dataset.ultrafeedback_binarized_dataset_offline_pairrm_part1
Dataset Card for "ultrafeedback_binarized_dataset_offline_pairrm_part1"
More Information needed
qwen3-8b_ultrafeedback_pairrmllama3-8b-instruct-on-policy-PairRMgranite38bit_pairrmgranite38bit_woalign_pairrmUCLA-AGI__Mistral7B-PairRM-SPPOUltraFeedback-for-vrpo-4answers-by-mistra-pairrm-preference-with-templateqwen3-4b-no-think_ultrafeedback_pairrmultrafeedback_binarized_dataset_offline_pairrm_part0
Dataset Card for "ultrafeedback_binarized_dataset_offline_pairrm_part0"
More Information needed
deepseek-llm-7b-chat_ultrafeedback_pairrmultrafeedback_binarized_dataset_offline_pairrm_part2
Dataset Card for "ultrafeedback_binarized_dataset_offline_pairrm_part2"
More Information needed
ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_3
Dataset Card for "ultrafeedback_binarized_dataset_offline_pairrm_part0_mini_3"
More Information needed
a4_lima_pairrm_preference_datadetails_UCLA-AGI__Mistral7B-PairRM-SPPO
Dataset Card for Evaluation run of UCLA-AGI/Mistral7B-PairRM-SPPO
Dataset automatically created during the evaluation run of model UCLA-AGI/Mistral7B-PairRM-SPPO.
The dataset is composed of 136 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An… See the full description on the dataset page: https://huggingface.co/datasets/OALL/details_UCLA-AGI__Mistral7B-PairRM-SPPO.SystemChat-1.1-Preferences-PairRMdetails_chujiezheng__Mistral7B-PairRM-SPPO-ExPO
Dataset Card for Evaluation run of chujiezheng/Mistral7B-PairRM-SPPO-ExPO
Dataset automatically created during the evaluation run of model chujiezheng/Mistral7B-PairRM-SPPO-ExPO.
The dataset is composed of 136 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the… See the full description on the dataset page: https://huggingface.co/datasets/OALL/details_chujiezheng__Mistral7B-PairRM-SPPO-ExPO.ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_2
Dataset Card for "ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_2"
More Information needed
gemma-3-12b-it_ultrafeedback_pairrmqwen3-4b-base_sft_no-think_ultrafeedback_pairrmultrafeedback_binarized_dataset_offline_pairrm_part1_mini_0
Dataset Card for "ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_0"
More Information needed
details_UCLA-AGI__Mistral7B-PairRM-SPPO-Iter3
Dataset Card for Evaluation run of UCLA-AGI/Mistral7B-PairRM-SPPO-Iter3
Dataset automatically created during the evaluation run of model UCLA-AGI/Mistral7B-PairRM-SPPO-Iter3.
The dataset is composed of 136 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest… See the full description on the dataset page: https://huggingface.co/datasets/OALL/details_UCLA-AGI__Mistral7B-PairRM-SPPO-Iter3.ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_1
Dataset Card for "ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_1"
More Information needed
hw4_pairRMpairrm-dpo-datasetpairrm-preference-datasetultrafeedback_binarized_dataset_offline_pairrm_part1_mini_2
Dataset Card for "ultrafeedback_binarized_dataset_offline_pairrm_part1_mini_2"
More Information needed
ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_0
Dataset Card for "ultrafeedback_binarized_dataset_offline_pairrm_part2_mini_0"
More Information needed
deepseek-math-7b-instruct_ultrafeedback_pairrmlima-pairrm-preference-dataset