CoolFace
Datasetpublic

Gro97/adaption-med-safety-preference-pairs

This dataset is a remastered version prepared using Adaption's Adaptive Data platform. adaption-med_safety_preference_pairs This dataset consists of medical preference pairs comparing chosen and rejected model completions across symptom evaluation, diagnosis, medications, and pharmacology. Scenarios include ambiguous patient presentations requiring clarifying questions, as well as critical safety checks regarding drug interactions, contraindications, and proper dosages. All… See the full description on the dataset page: https://huggingface.co/datasets/Gro97/adaption-med-safety-preference-pairs.

sourceHugging Faceupdated 24d agoView on Hugging Face
0likes84downloads
Dataset Card

banner

This dataset is a remastered version prepared using Adaption's Adaptive Data platform.

adaption-medsafetypreference_pairs

This dataset consists of medical preference pairs comparing chosen and rejected model completions across symptom evaluation, diagnosis, medications, and pharmacology. Scenarios include ambiguous patient presentations requiring clarifying questions, as well as critical safety checks regarding drug interactions, contraindications, and proper dosages. All cases focus on adult patients between 18 and 65 years old, excluding pediatric, geriatric, and psychiatric contexts.

Dataset size

There are 764 data points in this dataset. This is a preference training dataset.

Quality of Remastered Dataset

The final quality is B, with a relative quality improvement of -4.4%.

Domain

  • —Medical (98%)
  • —Legal (2%)

Language

  • —English (100%)

Tone

  • —Professional (34%)
  • —Cautious (22%)
  • —Technical (20%)

Evaluation Results

  • —Quality Gains: <img src="https://proteus-prod-public.s3.us-east-1.amazonaws.com/temp/52ca03fb-ec41-48f1-a4ab-5ab5c2dfdffa.png" alt="QualityGains" style="max-width: 50%; display: block; margin-left: auto; margin-right: auto;" />
  • —Grade Improvement: <img src="https://proteus-prod-public.s3.us-east-1.amazonaws.com/temp/fc728b51-9978-442b-977a-ca55f75cdc7a.png" alt="Grade" style="max-width: 50%; display: block; margin-left: auto; margin-right: auto;" />
  • —Percentile Chart: <img src="https://proteus-prod-public.s3.us-east-1.amazonaws.com/temp/0ad87386-db4c-491b-a8e0-1629104f06e5.png" alt="Percentile Chart" style="max-width: 50%; display: block; margin-left: auto; margin-right: auto;" />