lighteval/mutual_plus

1{"answers": " ", "options": ["M: Yeah, I can. And you mean the entrance to Son colleges is down 50 meters and it is a 20-mintue walk from Main Street to Water Square?", "M: Yeah. So, you mean the entrance to Son colleges is down 40 meters on my right and it is two blocks away from Main Street to Water Square?", "M: I\u2019m sorry, I didn\u2019t catch that. Would you mind speaking more slowly?", "M: Yea, I can. So, you mean I will walk 3 blocks until I see the farmers bank and it is 50 meters away from Main Street to Water Square?"], "article": "M: Excuse me mam, can you tell me how to get to Son College? I'm walking. F: Well, I think the simplest way for you is to go up to Main Street over there, turn left on Main Street and keep going for about 20 minutes, when you get to water square turn right keep on past the mass hospital to the end of the road and then take a left turn you'll be on rain avenue. Walk 2 blocks until you see the farmers bank, cross the street and almost immediately take a left turn again. The entrance to Son colleges is down 50 meters on your right. Can you remember all that?", "id": "test_42"}