CoolFace
Datasetpublic

joduor/adaption-biosecurity-risk-labels

This dataset is a remastered version prepared using Adaption's Adaptive Data platform. biosecurity_risk_labels This dataset contains pairs of prompts related to biotechnology, genetic engineering, and laboratory safety, each labeled with a risk assessment. The completions classify inputs as either 'LOW_RISK' for general educational or safety topics, or 'HIGH_RISK_INFOHAZARD' for requests detailing harmful procedures like pathogen synthesis or containment bypass. It serves as a… See the full description on the dataset page: https://huggingface.co/datasets/joduor/adaption-biosecurity-risk-labels.

sourceHugging Faceupdated 5mo agoView on Hugging Face
0likes19downloads
Dataset Card

banner

This dataset is a remastered version prepared using Adaption's Adaptive Data platform.

biosecurityrisklabels

This dataset contains pairs of prompts related to biotechnology, genetic engineering, and laboratory safety, each labeled with a risk assessment. The completions classify inputs as either 'LOWRISK' for general educational or safety topics, or 'HIGHRISK_INFOHAZARD' for requests detailing harmful procedures like pathogen synthesis or containment bypass. It serves as a benchmark for evaluating model safety filters against biological information hazards.

Dataset size

There are 8 data points in this dataset. This is a preference training dataset.

Quality of Remastered Dataset

The final quality is B, with a relative quality improvement of 92.5%.

Domain

  • —Science (50%)
  • —Governance (25%)
  • —Other (13%)

Language

  • —English (100%)

Tone

  • —Cautious (50%)
  • —Technical (13%)
  • —Balanced (13%)

Evaluation Results

  • —Quality Gains: <img src="https://proteus-prod-public.s3.us-east-1.amazonaws.com/temp/0a9e3fab-17bc-448d-990d-24b60038edae.png" alt="QualityGains" style="max-width: 50%; display: block; margin-left: auto; margin-right: auto;" />
  • —Grade Improvement: <img src="https://proteus-prod-public.s3.us-east-1.amazonaws.com/temp/7614f62c-49da-40c7-8966-8f5443c3be51.png" alt="Grade" style="max-width: 50%; display: block; margin-left: auto; margin-right: auto;" />
  • —Percentile Chart: <img src="https://proteus-prod-public.s3.us-east-1.amazonaws.com/temp/b86dcd4e-83ac-4ba3-b04d-936ac87fd68a.png" alt="Percentile Chart" style="max-width: 50%; display: block; margin-left: auto; margin-right: auto;" />