Datasetpublic

anon-meddial-2026/meddialbench

MedDialBench A controlled factorial benchmark for evaluating LLM diagnostic robustness under parametric adversarial patient behaviors. Anonymous submission to NeurIPS 2026 Datasets and Benchmarks Track. The companion paper is currently under double-blind review. Author identities and institutional affiliations are intentionally omitted. After publication, this repository will be transferred to a permanent (de-anonymized) location and this README updated accordingly.… See the full description on the dataset page: https://huggingface.co/datasets/anon-meddial-2026/meddialbench.

sourceHugging Facecc-by-4.0updated 5mo agoView on Hugging Face

2likes410downloads

31 commits on main

68fb83e5mo ago

remove intermediate-filter leftovers (288 dial + 288 eval, paper-excluded cases in single-dim configs); HF now matches paper §3.3 description: 5 models × 107 baseline + 5 × 16 × 85 single-dim = 7,335 dialogues

anon-meddial-2026

37cd9085mo ago

add note on case counts (107 baseline vs 85 non-baseline)

anon-meddial-2026

46f54eb5mo ago

add 22 excluded-case baselines for claude/qwen (paper §3.3 diagnosability filter)

anon-meddial-2026

c06f9395mo ago

add dialogues config (auto-inferred schema) as default viewer

anon-meddial-2026

094252e5mo ago

add skip_reason_judge1 to schema (nullable string)

anon-meddial-2026

7774feb5mo ago

fix disclosure_turns schema: sequence instead of scalar

anon-meddial-2026

1c78f4f5mo ago

add configs declaration with explicit feature schema for HF viewer

anon-meddial-2026

fbb6cd85mo ago