CoolFace
Datasetpublic

J-Q/LLM-Red-Teaming-Cognitive-Profiles

A Novel Biomimetic Approach to Red Teaming A.I. Models This dataset presents the results of a red teaming experiment using simulated cognitive profiles to test the behavioral reliability of large language models (LLMs). By mimicking five neurocognitive conditions — ADHD, Amnesia, OCD, Schizophrenia, and Split-brain Syndrome — we expose LLMs to distorted or fragmented reasoning patterns and measure the results. Dataset Overview Each entry consists of: A prompt… See the full description on the dataset page: https://huggingface.co/datasets/J-Q/LLM-Red-Teaming-Cognitive-Profiles.

sourceHugging Facemitupdated 1y agoView on Hugging Face
0likes9downloads
Dataset Card

tags:

  • —text-classification
  • —ai-safety
  • —alignment
  • —red-teaming
  • —neurodiversity
  • —human-eval license: mit datasets:
  • —llm-cognitive-red-teaming language:
  • —en ---

A Novel Biomimetic Approach to Red Teaming A.I. Models

This dataset presents the results of a red teaming experiment using simulated cognitive profiles to test the behavioral reliability of large language models (LLMs). By mimicking five neurocognitive conditions — ADHD, Amnesia, OCD, Schizophrenia, and Split-brain Syndrome — we expose LLMs to distorted or fragmented reasoning patterns and measure the results.

Dataset Overview

Each entry consists of:

  • —A prompt distorted to reflect a specific cognitive profile
  • —An LLM-generated response
  • —Manual human annotations for:
  • —Hallucination
  • —Contradiction
  • —Prompt deviation
  • —Prompt leak
  • —Repetition
  • —Coherence (scored 1–5)
  • —Automated heuristic tags for comparison

Total entries: 57 prompt-response-profile combinations

⚠️ Note: Due to Hugging Face viewer limitations, only 5 sample rows appear in the preview. To explore the full dataset (57 entries), download the CSV directly or load it with pandas.read_csv().

File Descriptions

  • —master_llm_tagged_dataset_autotagged_updated.csv: Main dataset with prompt/response pairs, human tags, and auto-tags.
  • —*.png: Heatmaps showing tag distributions by profile and prompt.
  • —README.md: This dataset card.

Tags

  • —text-classification
  • —ai-safety
  • —alignment
  • —red-teaming
  • —neurodiversity
  • —human-eval

License

MIT

Citation

Paul J. Lesevic, ChatGPT-4o. (2025). A Novel Biomimetic Approach to Red Teaming A.I. Models.

Related Links