lighteval/mutual_plus

1{"answers": " ", "options": ["F: I am afraid I did not quite catch what you were saying. Please repeat it.", "F: Sure. I am so sorry that the menu is not available at all. It's too late and we don't serve lunch anymore.", "F: Sure. I apologize that not the full menu is available. One of our cook is sick today, so we don't have sandwiches.", "F: Sure. I apologize that not the full menu is available. One of our cook is sick today, so we don't have burgers."], "article": "M: I'd like a cup of coffee and a cheeseburger, please. F: I'm sorry, but we don't have any burgers at the moment. M: But you always serve your whole menu for breakfast, lunch and dinner. That's why I come here. F: You're right. But one of our cooks is sick, so we had to take some things off the menu for a while. If you want to come back in half an hour, we'll definitely have our normal lunch menu. M: That's OK. I'm really hungry. Let me see. I'll still take the coffee and I'll have a bacon and egg sandwich instead, please.", "id": "test_217"}