20 results

preference-data

inall models datasets apps agents people projects

Models

All models matching “preference-data”

vectorzhou /gemma-2-2b-it-preference_dataset_mixture2_and_safe_pku-Preferencetext-classificationtransformers0 likes192 downloads1y agoHugging Face data-is-better-together /open-image-preferences-v1-flux-dev-loratext-to-imagediffusers27 likes169 downloads2y agoHugging Face living-box /gemma-3-1b-it-preference_dataset_mixture2_and_safe_pku-Preferencetext-generationtransformers0 likes17 downloads8mo agoHugging Face living-box /gemma-3-1b-it-preference_dataset_mixture2_and_safe_pku-Preference1text-generationtransformers0 likes12 downloads8mo agoHugging Face lakshyaixi /Llama_3_2_1B_Filler_context_based_training_data_20251105_172125_DPO_preference_finetuned_dec10text-generationtransformersen0 likes11 downloads10mo agoHugging Face lakshyaixi /Llama_3_2_1B_Filler_preference_based_training_data_20251210_080644_DPOtext-generationtransformersen0 likes10 downloads10mo agoHugging Face sert121 /orpo_run_yash_lora_44_preference_data_v10_for_orpopeft0 likes9 downloads2y agoHugging Face p878567 /gemma-2-2b-it-preference_dataset_mixture2_and_safe_pku-Preferencetext-classificationtransformers0 likes8 downloads1y agoHugging Face