models
Open weights, fine-tunes and adapters. Every listing here comes live from the Hugging Face Hub, attributed to it, and links back to the source.
OLMo-2-0425-1B-DPONous-Hermes-2-Mixtral-8x7B-DPOOlmo-3-7B-Instruct-DPOgemma-3-1b-vanilla-dpo-123-seedOlmo-3-7B-Think-DPOSlerp-CM-mist-dpofree-llama3-dpo-v0.2Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13BFaro-Yi-9B-DPOYi-34Bx2-MoE-60B-DPOMoE_13B_DPObagel-dpo-34b-v0.2TomGrc_FusionNet_34Bx2_MoE_v0.1_DPO_f16Faro-Yi-34B-DPOjuud-Mistral-7B-dpojanus-dpo-7bbagel-dpo-34b-v0.5LLaMA3-iterative-DPO-final-ExPOtulu-2-dpo-70b-ExPOllama-3-nectar-dpo-8Bairoboros-dpo-70b-3.3Miqu-70B-Alpaca-DPO-i1-GGUFLlama-3.1-Tulu-3-8B-DPONous-Hermes-2-Mixtral-8x7B-DPO-i1-GGUFbagel-dpo-34b-v0.5-i1-GGUFsonthenguyen_-_OpenHermes-2.5-Mistral-7B-mt-bench-DPO-recovered-ggufIceTea21EnergyDrinkRPV13-DPOv3-i1-GGUFChocolatine-14B-Instruct-DPO-v1.2-i1-GGUFdolphin-2.6-mistral-7B-dpo-laser-GGUFFireball-Meta-Llama-3.2-8B-Instruct-agent-003-128k-code-DPO-i1-GGUF