SCAI-JHU/MUMA-TOM-BENCHMARK

MuMA-ToM: Multi-modal Multi-Agent Theory of Mind AAAI 2025 (Oral) [🏠Homepage] [💻Code] [📝Paper] MuMA-ToM is the first multi-modal Theory of Mind benchmark designed to evaluate mental reasoning in embodied multi-agent interactions. The benchmark was designed with several key features in mind: It is factually correct, concise, and readable. It requires integrating information from multiple modalities to answer the questions. It tests understanding of multi-agent interactions… See the full description on the dataset page: https://huggingface.co/datasets/SCAI-JHU/MUMA-TOM-BENCHMARK.