lighteval/mutual_plus

1{"answers": "A", "options": ["M: Yeah, you're right. These shirts are ugly.", "M: Yeah, you're right. These shirts are satisfying.", "M: Yeah, you're right. These shirts are beautiful but expensive.", "M: I\u2019m sorry, I don\u2019t understand. Could you say it again?"], "article": "M: I love these T-shirts, but they're pretty expensive. I only have $20. F: Hey these T-shirts are only $12. 00. M: So, what color? Do you like the red or the yellow one? F: Not really. Hey all these shirts are red and yellow. Awful colors you know, I think that's why they're on sale.", "id": "dev_146"}