CoolFace
Datasetpublic

Fair-HV/Ethical-Reasoning-5k

Ethical Reasoning - DPO Dataset EthicalReasoning is a dataset designed for the Direct Preference Optimization (DPO) stage in conversational AI training pipelines. It provides preference pairs for ethical and moral reasoning in dialogue contexts. The dataset is built to align model responses with consistent ethical principles without enforcing a generic "assistant" persona. Instead, it focuses on moral coherence, ensuring models can navigate social situations with appropriate… See the full description on the dataset page: https://huggingface.co/datasets/Fair-HV/Ethical-Reasoning-5k.

sourceHugging Faceupdated 1mo agoView on Hugging Face
0likes7downloads
Dataset Card

Ethical Reasoning - DPO Dataset

EthicalReasoning is a dataset designed for the Direct Preference Optimization (DPO) stage in conversational AI training pipelines. It provides preference pairs for ethical and moral reasoning in dialogue contexts.

The dataset is built to align model responses with consistent ethical principles without enforcing a generic "assistant" persona. Instead, it focuses on moral coherence, ensuring models can navigate social situations with appropriate judgment while maintaining their "character"

Unlike traditional alignment datasets that prioritize harmlessness and helpfulness, EthicalReasoning is designed for models that require a clear moral compass without sacrificing "personality" or "agency"

Use cases

In conversational AI, maintaining ethical consistency is critical, especially for models designed to interact with humans in open-ended scenarios. This dataset addresses the need for:

  1. 1.Coherent ethical reasoning in social contexts.
  2. 2.Avoidance of harmful, violent, or misleading content.
  3. 3.Consistent moral judgment without excessive neutrality or corporate-style filtering.
  4. 4.Natural handling of emotionally charged situations.

The dataset is intended for models that need to express opinions, preferences, and even negative emotions while staying within ethical boundaries.

Composition

The dataset is a cleaned and formatted merge of two public sources:

Original DatasetDescriptionContribution
ProlificAI/social-reasoning-rlhfSocial scenarios with human preferences for ethical responses.~4,000 examples of social and moral reasoning.
Not-qty/ols-moral-stories-2kShort moral stories with ethical dilemmas and value judgments.~1,820 examples of narrative ethical dilemmas.

Total: 5,820 preference examples, averaging ~4.2 turns per example.

Format

The dataset follows the standard DPO (Direct Preference Optimization) structure, providing a prompt with two responses: a chosen (preferred) and a rejected (dispreferred) one.