stindardlogic/instruction-following-dpo-100k

Instruction Following DPO (100K) 100,000 DPO preference pairs training LLMs to follow explicit formatting and structural constraints exactly — word counts, list lengths, output formats, tone, language, and more. Motivation Format non-compliance is one of the most common and costly LLM failure modes in production: Model gives 6 bullet points when asked for exactly 5 Returns markdown-wrapped JSON when raw JSON was required Ignores word limits, producing… See the full description on the dataset page: https://huggingface.co/datasets/stindardlogic/instruction-following-dpo-100k.