lighteval/mutual_plus

1{"answers": "A", "options": ["M: Yes, If you want to go to Atlanta, there is no direct flight from New York.", "M: No, you can take direct flight to Chicago instead of changing planes in New York.", "M: Yes, you can change line in Washington or Chicago to New York.", "M: Just a minute! I do not quite follow what you are saying, would you mind repeating that?"], "article": "M: You can change planes in either Chicago or Denver. F: You mean there's no direct flight from New York to Atlanta?", "id": "dev_597"}