nbeerbower/Dumpling-Qwen2.5-72B

Dumpling-Qwen2.5-72B

nbeerbower/EVA-abliterated-TIES-Qwen2.5-72B finetuned on:

• —nbeerbower/GreatFirewall-DPO
• —nbeerbower/Schule-DPO
• —nbeerbower/Purpura-DPO
• —nbeerbower/Arkhaios-DPO
• —jondurbin/truthy-dpo-v0.1
• —antiven0m/physical-reasoning-dpo
• —flammenai/Date-DPO-NoAsterisks
• —flammenai/Prude-Phi3-DPO
• —Atsunori/HelpSteer2-DPO
• —jondurbin/gutenberg-dpo-v0.1
• —nbeerbower/gutenberg2-dpo
• —nbeerbower/gutenberg-moderne-dpo.

Method

QLoRA ORPO tuned with 8x A100 for 1.5 epochs.