models
Open weights, fine-tunes and adapters. Every listing here comes live from the Hugging Face Hub, attributed to it, and links back to the source.
gemma-3-1b-it-preference_dataset_mixture2_and_safe_pku-PreferenceLlama_3_2_1B_Filler_context_based_training_data_20251105_172125_DPO_preference_finetuned_dec10Llama_3_2_1B_Filler_preference_based_training_data_20251210_114617_DPO_v2Llama_3_2_1B_Filler_preference_based_training_data_20251210_080644_DPOgemma-3-1b-it-preference_dataset_mixture2_and_safe_pku-Preference1Llama_3_2_1B_Filler_preference_based_training_data_20251212_061616_DPO_v3gemma-2-2b-it-preference_dataset_mixture2_and_safe_pku-PreferenceMNLP_purturbed_preference_data_completeness_hingeMNLP_purturbed_preference_data_correctness_hingeMNLP_purturbed_preference_data_relevance_hingeMNLP_purturbed_preference_data_clarity_hingeMNLP_purturbed_preference_data_relevance_rampMNLP_purturbed_preference_data_clarity_rampMNLP_purturbed_preference_data_correctness_rampMNLP_purturbed_preference_data_Qwen3-0_rampMNLP_purturbed_preference_data_completeness_rampMNLP_purturbed_preference_data_qwen_ramp_clean_ramp