lighteval/mutual_plus

1{"answers": "D", "options": ["M: Don't worry. I'll tell you how to get to the bank.", "M: The road was deserted. We couldn't find anyone to direct us to the downtown.", "M: The train is late and we are sure to miss the party.", "M: I\u2019m sorry, I didn\u2019t catch that. Would you mind speaking more slowly?"], "article": "F: Where on earth is it, John? I hope we're going the right way. M: Uhm, judging by the traffic, I think we are near the heart of the downtown area. F: Oh, no, we should be heading for the village. Did I make a wrong turn? M: I'm not sure. But I guess that you turned right when you should have turned left. F: Well, now the problem is how to get back on to the main highway. It's too bad that we will be late for the party.", "id": "dev_415"}