lighteval/mutual_plus

1{"answers": " ", "options": ["F: Thanks for helping me hake some sandwiches. Merry Christmas!", "F: Just a minute! I do not quite follow what you are saying, would you mind repeating that?", "F: Thanks for cooking a big turkey for me. Merry Christmas!", "F: Thanks for going shopping with me. We need to get a Turkey."], "article": "F: Do you realize it's November already before you know it? Thanksgiving will be here. M: Shh, you're right. It's time we decided what we're going to do this year. Well do you feel like inviting your sister and her family over, otherwise I'd like to invite my brother and his family. F: I'd love to invite my sister's family. After all, they invited us last year. M: Good, that settled. Why don't you give your sister a call and see if they can come? F: Sure. Say Randy can you help me with the shopping? We need to get a Turkey. M: Right. Let's get a nice, big one. So we'll have plenty of leftovers to make sandwiches with.", "id": "test_69"}