lighteval/mutual_plus

1{"answers": "B", "options": ["F: There's no shelf here, so put the vase near the fire place.", "F: Now, help me bring the vase here near our bookshelf.", "F: Just put this ugly vase near the shelf. I don't want to see it.", "F: I am really sorry, I did not catch that. Would you slow down, please?"], "article": "F: I think this vase is really beautiful. I want to put it where everyone can see it. M: Yeah, I think here next to the fireplace will be perfect. F: No way. The heat may ruin the vase. I think next to the sofa will be pretty. M: You know how our kids are, they'll knock it over when they're running around. F: Well, how about here? Beside the bookshelf. M: OK that's a good idea.", "id": "dev_262"}