models
Open weights, fine-tunes and adapters. Every listing here comes live from the Hugging Face Hub, attributed to it, and links back to the source.
OLMo-2-0425-1B-DPONous-Hermes-2-Mixtral-8x7B-DPOOlmo-3-7B-Instruct-DPOOlmo-3-7B-Think-DPOSlerp-CM-mist-dpofree-llama3-dpo-v0.2Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13BFaro-Yi-9B-DPOYi-34Bx2-MoE-60B-DPOMoE_13B_DPObagel-dpo-34b-v0.2TomGrc_FusionNet_34Bx2_MoE_v0.1_DPO_f16Faro-Yi-34B-DPOjuud-Mistral-7B-dpojanus-dpo-7bbagel-dpo-34b-v0.5LLaMA3-iterative-DPO-final-ExPOtulu-2-dpo-70b-ExPOllama-3-nectar-dpo-8Bairoboros-dpo-70b-3.3Llama-3.1-Tulu-3-8B-DPOOLMo-2-1124-7B-DPOChocolatine-3B-Instruct-DPO-v1.2-GGUFcommunicative-baby-dpoAMD-OLMo-1B-SFT-DPO-GGUFLLaMA3-iterative-DPO-final-GGUFcommunicative-baby-dpo-syntheticfull_chinese_gpu3.2-dpoKunoichi-DPO-v2-7B-GGUFChocolatine-3B-Instruct-DPO-Revised-Q4_K_M-GGUF