30 shown

models

Open weights, fine-tunes and adapters. Every listing here comes live from the Hugging Face Hub, attributed to it, and links back to the source.

01vectorzhou /gemma-2-2b-it-preference_dataset_mixture2_and_safe_pku-Preferencetext-classificationtransformers0 likes192 downloads1y agoHugging Face 02data-is-better-together /open-image-preferences-v1-flux-dev-loratext-to-imagediffusers27 likes169 downloads2y agoHugging Face 03living-box /gemma-3-1b-it-preference_dataset_mixture2_and_safe_pku-Preferencetext-generationtransformers0 likes17 downloads8mo agoHugging Face 04living-box /gemma-3-1b-it-preference_dataset_mixture2_and_safe_pku-Preference1text-generationtransformers0 likes12 downloads8mo agoHugging Face 05lakshyaixi /Llama_3_2_1B_Filler_context_based_training_data_20251105_172125_DPO_preference_finetuned_dec10text-generationtransformersen0 likes11 downloads10mo agoHugging Face 06lakshyaixi /Llama_3_2_1B_Filler_preference_based_training_data_20251210_080644_DPOtext-generationtransformersen0 likes10 downloads10mo agoHugging Face 07sert121 /orpo_run_yash_lora_44_preference_data_v10_for_orpopeft0 likes9 downloads2y agoHugging Face 08p878567 /gemma-2-2b-it-preference_dataset_mixture2_and_safe_pku-Preferencetext-classificationtransformers0 likes8 downloads1y agoHugging Face 09living-box /gemma-2-2b-it-preference_dataset_mixture2_and_safe_pku-Preferencetext-generationtransformers0 likes8 downloads9mo agoHugging Face 10sert121 /orpo_run_yash_lora_36_preference_data_v8_for_orpopeft0 likes7 downloads2y agoHugging Face 11sayantan0013 /MNLP_purturbed_preference_data_completeness_hingetext-generationtransformers0 likes7 downloads1y agoHugging Face 12sayantan0013 /MNLP_purturbed_preference_data_correctness_hingetext-generationtransformers0 likes7 downloads1y agoHugging Face 13sayantan0013 /MNLP_purturbed_preference_data_relevance_hingetext-generationtransformers0 likes7 downloads1y agoHugging Face 14sayantan0013 /MNLP_purturbed_preference_data_clarity_hingetext-generationtransformers0 likes7 downloads1y agoHugging Face 15sayantan0013 /MNLP_purturbed_preference_data_relevance_ramptext-generationtransformers0 likes7 downloads1y agoHugging Face 16sayantan0013 /MNLP_purturbed_preference_data_clarity_ramptext-generationtransformers0 likes7 downloads1y agoHugging Face 17lakshyaixi /Llama_3_2_1B_Filler_preference_based_training_data_20251210_114617_DPO_v2text-generationtransformersen0 likes7 downloads10mo agoHugging Face 18lakshyaixi /Llama_3_2_1B_Filler_preference_based_training_data_20251212_061616_DPO_v3text-generationtransformersen0 likes7 downloads9mo agoHugging Face 19sert121 /orpo_run_yash_beta_0.3_preference_data_v8_for_orpo_v2peft0 likes6 downloads2y agoHugging Face 20sert121 /orpo_run_yash_lora_48_preference_data_v10_for_orpopeft0 likes6 downloads2y agoHugging Face 21sayantan0013 /MNLP_purturbed_preference_data_correctness_ramptext-generationtransformers0 likes6 downloads1y agoHugging Face 22sayantan0013 /MNLP_purturbed_preference_data_Qwen3-0_ramptext-generationtransformers0 likes6 downloads1y agoHugging Face 23vectorzhou /gemma-2-2b-it-preference_dataset_mixture2_and_safe_pku-Preference-2048text-classificationtransformers0 likes6 downloads1y agoHugging Face 24sert121 /orpo_run_yash_beta_0.1_preference_data_v8_for_orpo_thirds_datapeft0 likes5 downloads2y agoHugging Face 25sert121 /orpo_run_yash_lora_48_preference_data_v8_for_orpopeft0 likes5 downloads2y agoHugging Face 26sert121 /orpo_run_yash_lora_40_preference_data_v8_for_orpopeft0 likes5 downloads2y agoHugging Face 27sert121 /orpo_run_yash_lora_44_preference_data_v8_for_orpopeft0 likes5 downloads2y agoHugging Face 28sert121 /orpo_run_yash_beta_0.3_preference_data_v9_for_orpopeft0 likes5 downloads2y agoHugging Face 29sert121 /orpo_run_yash_lora_36_preference_data_v9_for_orpopeft0 likes5 downloads2y agoHugging Face 30sert121 /orpo_run_yash_lora_40_preference_data_v9_for_orpopeft0 likes5 downloads2y agoHugging Face

Listings come live from the Hugging Face Hub API. CoolFace does not host these files.