CoolFace
Datasetpublic

reasoning-degeneration-dev/t1-musr-structured-murder-together_ai-qwen-qwen3-next-80b-a3b-thin-caaf5585

t1-musr-structured-murder-together_ai-qwen-qwen3-next-80b-a3b-thin-caaf5585 Structured slot-filling evaluation for MuSR murder mysteries. Instead of the original paper's freeform cot+ hint, this uses a structured algorithm that forces the model to extract facts, slot-fill means/motive/opportunity, and compare suspects. Comparison to Baseline Metric Baseline (cot+) Structured (slot-fill) Delta pass@1 0.8000 0.7000 -0.1000 Results… See the full description on the dataset page: https://huggingface.co/datasets/reasoning-degeneration-dev/t1-musr-structured-murder-together_ai-qwen-qwen3-next-80b-a3b-thin-caaf5585.

sourceHugging Facemitupdated 7mo agoView on Hugging Face
0likes10downloads
4 commits on main
090f4477mo ago

Upload figures/comparison_chart.png with huggingface_hub

zsprague
fa0a5da7mo ago

Upload README.md with huggingface_hub

zsprague
c6ebe4e7mo ago

Upload dataset

zsprague
d00e1ef7mo ago

initial commit

zsprague