CoolFace
Datasetpublic

reasoning-degeneration-dev/t1-musr-structured-murder-together_ai-qwen-qwen3-next-80b-a3b-inst-4d7e26c9

t1-musr-structured-murder-together_ai-qwen-qwen3-next-80b-a3b-inst-4d7e26c9 Structured slot-filling evaluation for MuSR murder mysteries. Instead of the original paper's freeform cot+ hint, this uses a structured algorithm that forces the model to extract facts, slot-fill means/motive/opportunity, and compare suspects. Results Metric Value pass@1 0.8000 Total problems 10 Structured Prompt (excerpt) You are solving a murder mystery.… See the full description on the dataset page: https://huggingface.co/datasets/reasoning-degeneration-dev/t1-musr-structured-murder-together_ai-qwen-qwen3-next-80b-a3b-inst-4d7e26c9.

sourceHugging Facemitupdated 7mo agoView on Hugging Face
0likes14downloads

reasoning-degeneration-dev/t1-musr-structured-murder-together_ai-qwen-qwen3-next-80b-a3b-inst-4d7e26c9 · main · files are served by the source, never re-hosted here