lighteval/mutual_plus

1{"answers": "C", "options": ["F: I am really sorry, I did not catch that. Would you slow down, please?", "F: Passport, and cheque. Fine, sir. Your economic class ticket is ready, sir.", "F: Let me check if there's empty window seat. May I have your cheque?", "F: There is a pass-way seat as you required. May I have your card, please?"], "article": "M: Hello, I need to schedule my trip to Paris for next week. F: When would you like to travel? M: I have to reach Paris by the twenty-fourth. F: Is this a round trip? Will you need a return to get to? M: Yes, and check that for thirty-first in the evening. F: Let me see, uh, there's a non-stop flight to Paris from Kennedy Airport on twenty-fourth at 6:00 am. On thirty-first you may board flight 309, which is at 4:30 pm. But it will stop for about 4 hours in London before it returns to New York. M: OK, fine. I think that can work for me. F: Would you like to book the tickets then? M: Yes, I'd like a business class ticket. What's the cost? F: It will be $2,750. Will you pay by card or in cash? M: Neither. Do you accept checks? F: Yes, we do. M: OK, I prefer a window seat. Here is my passport.", "id": "dev_27"}