lighteval/mutual_plus

1{"answers": "C", "options": ["M: OK. Although I only reserved two single rooms but actually I want to have a two-room suite.", "M: Great! The only room available now is a single room and I just want to have a single room.", "M: Really? The only room available now is a two-room suite? But I want to have a single room.", "M: I am sorry. You spoke so rapidly that I did not catch the meaning of what you said. Could you repeat that?"], "article": "F: Yes, sir. May I help you? M: I have a reservation for tonight, John Durban? F: Just a moment, please. Let me check. That's right. You have a reservation for a two-room suite for tonight. M: I'm afraid there's been a mistake. I only reserved a single room, not a suite. F: Well, sir, the only room available now is a two-room suite.", "id": "dev_608"}