datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
CausalReasoningBenchmark
Automated Causal Reasoning Benchmark
Overview
The Automated Causal Reasoning Benchmark is a collection of real-world causal inference tasks drawn from 73 peer-reviewed research papers and three textbook-style collections (see CausalBenchmark.pdf). The benchmark contains 174 queries over 139 datasets. Each task is designed to evaluate both (i) identification, i.e., selecting an appropriate causal estimand and identification strategy given the study context, and… See the full description on the dataset page: https://huggingface.co/datasets/syrgkanislab/CausalReasoningBenchmark.causalverify-neurips2026
🎯 CausalVerify
An Execution-Grounded Benchmark for LLM Causal Inference Workflows
NeurIPS 2026 — Evaluations and Datasets Track · double-blind review · frozen at tag neurips2026-submission
💡 TL;DR
A benchmark of 259 published economics papers (Experiment A — real-paper text-agreement diagnostic) and 100 fixed-seed synthetic data-generating processes (Experiment B — execution-grounded coefficient recovery), evaluating 7 frontier LLMs. The central… See the full description on the dataset page: https://huggingface.co/datasets/causalverify/causalverify-neurips2026.CausalReasoningBenchmark
Automated Causal Reasoning Benchmark
Anonymized benchmark release. Author, affiliation, and prior-whitepaper material have been removed.
Overview
The Automated Causal Reasoning Benchmark is a collection of real-world causal inference tasks drawn from 73 peer-reviewed research papers and three textbook-style collections. The benchmark contains 174 queries over 139 datasets. Each task is designed to evaluate both (i) identification, i.e., selecting an appropriate… See the full description on the dataset page: https://huggingface.co/datasets/anonsubmission16/CausalReasoningBenchmark.nam-causal-head-gating
NAM Causal Head Gating Datasets
Datasets for the nam-causal-head-gating Python package.
Paper: Causal Head Gating: A Framework for Interpreting Roles of Attention Heads in Transformers (NeurIPS 2025)
Authors: Andrew Nam, Henry Conklin, Yukang Yang, Thomas Griffiths, Jonathan Cohen, Sarah-Jane Leslie
Datasets
aba_abb
Pattern recognition dataset for testing induction heads in transformer models.
Format: TSV (tab-separated values)
Columns: prompt, target… See the full description on the dataset page: https://huggingface.co/datasets/jonhanke-nam/nam-causal-head-gating.clinical_causal_blindspot_probe_v0.1Clinical Causal Blindspot Probe
Detect when a clinician locks onto one cause and ignores alternative causal drivers.
Output JSON
blindspot
blindspot_type
correct_action
Run scoringpython scorer.py --predictions predictions.jsonl --test_csv data/test.csv