stindardlogic/instruction-following-dpo-100k
Instruction Following DPO (100K) 100,000 DPO preference pairs training LLMs to follow explicit formatting and structural constraints exactly — word counts, list lengths, output formats, tone, language, and more. Motivation Format non-compliance is one of the most common and costly LLM failure modes in production: Model gives 6 bullet points when asked for exactly 5 Returns markdown-wrapped JSON when raw JSON was required Ignores word limits, producing… See the full description on the dataset page: https://huggingface.co/datasets/stindardlogic/instruction-following-dpo-100k.
Instruction Following DPO (100K)
100,000 DPO preference pairs training LLMs to follow explicit formatting and structural constraints exactly — word counts, list lengths, output formats, tone, language, and more.
Motivation
Format non-compliance is one of the most common and costly LLM failure modes in production:
- Model gives 6 bullet points when asked for exactly 5
- Returns markdown-wrapped JSON when raw JSON was required
- Ignores word limits, producing multi-paragraph answers to "in under 20 words"
- Uses formal tone when casual was requested
- Responds in English when French was specified
This dataset trains models to treat formatting constraints as hard requirements, not suggestions.
Dataset Description
100,000 preference pairs across 26 constraint types:
Format
{
"prompt": "List exactly 3 benefits of daily exercise. Use bullet points.",
"chosen": "• Improves cardiovascular health and reduces heart disease risk\n• Boosts mood by releasing endorphins and reducing anxiety\n• Strengthens muscles and bones, reducing injury risk over time",
"rejected": "• Improves cardiovascular health\n• Boosts mood and mental health\n• Strengthens muscles and bones\n• Helps maintain a healthy weight\n• Improves sleep quality",
"metadata": {
"constraint_type": "exact_list_count",
"violation": "Lists 5 benefits instead of exactly 3"
},
"id": "abc123"
}Design Principles
Chosen responses:
- Follow every stated constraint exactly (count, format, tone, structure)
- Still provide accurate, high-quality content
- Don't mention or acknowledge the constraint
Rejected responses:
- Contain accurate, often well-written content
- Violate exactly one specific constraint
- The
violationfield names the exact failure for analysis
Violation Taxonomy
The metadata.violation field records why the rejected response fails, enabling:
- Filtering by failure mode for targeted training
- Analysis of which constraints models already handle vs. struggle with
- Curriculum learning (train on hard constraints first)
Use Case
- DPO/RLHF fine-tuning for format compliance
- Reducing instruction-following failures in structured output tasks
- Training models for production deployments where output format matters (APIs, documents, pipelines)
- Complement to content-quality training — this targets how to respond, not what to respond
License
Apache 2.0
