stindardlogic/writing-quality-dpo-100k
Writing Quality DPO (100K) 100,000 DPO preference pairs training models to write with clarity, concision, structure, and impact. Each chosen response demonstrates high-quality prose; each rejected response contains exactly one identified writing defect. Motivation Writing assistance is the #1 use case for LLMs, yet most training data optimizes for factual correctness rather than writing craft. This dataset trains models to distinguish genuinely good writing from… See the full description on the dataset page: https://huggingface.co/datasets/stindardlogic/writing-quality-dpo-100k.
Writing Quality DPO (100K)
100,000 DPO preference pairs training models to write with clarity, concision, structure, and impact. Each chosen response demonstrates high-quality prose; each rejected response contains exactly one identified writing defect.
Motivation
Writing assistance is the #1 use case for LLMs, yet most training data optimizes for factual correctness rather than writing craft. This dataset trains models to distinguish genuinely good writing from writing that is technically correct but verbose, vague, clichéd, poorly structured, or otherwise weak.
Dataset Description
100,000 preference pairs across 19 writing defect categories:
Format
{
"prompt": "Write a short paragraph explaining why sleep is important for health.",
"chosen": "Sleep is when your body repairs tissue, consolidates memories, and regulates hormones like cortisol and insulin. Adults who consistently get fewer than seven hours are at significantly higher risk for obesity, type 2 diabetes, cardiovascular disease, and depression. Even one night of poor sleep impairs attention and decision-making to a degree comparable to mild intoxication.",
"rejected": "It is very important to understand that sleep plays a crucial and essential role in our overall health and well-being. When we sleep, our bodies go through various important processes...[continues for 3x the words]",
"metadata": {
"violation_type": "verbose",
"violation": "Pads simple content with filler phrases and unnecessary repetition, tripling the word count"
},
"id": "abc123"
}Design Principles
Chosen responses:
- High-quality prose demonstrating the targeted skill (specificity, structure, concision, etc.)
- Include concrete examples, real numbers, or named specifics where relevant
- Vary across domains: tech, business, science, personal finance, history, product writing
Rejected responses:
- Contain accurate information — they fail on craft, not correctness
- Exhibit exactly one specific, named defect
- Often look "acceptable" to a reader who isn't analyzing writing quality — making the DPO signal non-trivial
Training Signal
Unlike content-quality DPO pairs where the chosen response is factually superior, this dataset's chosen/rejected pairs often contain the same facts. The training signal is purely about how those facts are communicated. This makes the dataset:
- Complementary to factual accuracy and instruction-following datasets
- Targeted at the specific failure modes most visible in LLM writing outputs
- Analyzable: the
violation_typefield enables filtering and curriculum learning
Use Cases
- DPO/RLHF fine-tuning for writing assistants
- Reducing verbosity and hedging in LLM outputs
- Training models for copywriting, content generation, and professional communication
- Diagnostic tool: test your model on the 19 violation categories to identify which it already handles
License
Apache 2.0
