deliberative-reasoning
t1-musr-deliberative-murder-together_ai-qwen-qwen3-next-80b-a3b-thin-f232e1e3
t1-musr-deliberative-murder-together_ai-qwen-qwen3-next-80b-a3b-thin-f232e1e3
Deliberative reasoning evaluation for MuSR murder mysteries. The model investigates
each suspect one at a time — exhaustively gathering ALL evidence for means, motive,
and opportunity — then deliberates between suspects to reach a verdict.
Comparison to Baseline
Metric
Baseline (cot+)
Deliberative
Delta
pass@1
0.8000
0.9000
+0.1000
Results
Metric
Value… See the full description on the dataset page: https://huggingface.co/datasets/reasoning-degeneration-dev/t1-musr-deliberative-murder-together_ai-qwen-qwen3-next-80b-a3b-thin-f232e1e3.t1-musr-deliberative-murder-together_ai-qwen-qwen3-next-80b-a3b-inst-edd0bb0d
t1-musr-deliberative-murder-together_ai-qwen-qwen3-next-80b-a3b-inst-edd0bb0d
Deliberative reasoning evaluation for MuSR murder mysteries. The model investigates
each suspect one at a time — exhaustively gathering ALL evidence for means, motive,
and opportunity — then deliberates between suspects to reach a verdict.
Results
Metric
Value
pass@1
0.9000
Total problems
10
Deliberative Prompt (excerpt)
You are a detective solving a murder mystery.… See the full description on the dataset page: https://huggingface.co/datasets/reasoning-degeneration-dev/t1-musr-deliberative-murder-together_ai-qwen-qwen3-next-80b-a3b-inst-edd0bb0d.