lighteval/mutual_plus

1{"answers": "A", "options": ["F: Then we have agreed on this. Darling, it's your time to move it now.", "F: I really hope our second kid to be born also love this vase in the future.", "F: Sounds good! Thank you for your advise on my vase design, professor.", "F: I\u2019m sorry, I didn\u2019t catch that. Would you mind speaking more slowly?"], "article": "F: I think this vase is really beautiful. I want to put it where everyone can see it. M: Yeah, I think here next to the fireplace will be perfect. F: No way. The heat may ruin the vase. I think next to the sofa will be pretty. M: You know how our kids are, they'll knock it over when they're running around. F: Well, how about here? Beside the bookshelf. M: OK that's a good idea.", "id": "dev_263"}