lighteval/mutual_plus

1{"answers": "D", "options": ["M: I have invited Cathy.", "M: Cathy planed the party. But she won't attend it cause she has no time.", "M: Excuse me, could you repeat the question?", "M: Cathy planed the party. Of course she will attend it."], "article": "M: Shouldn't we invite Kathy to the party tonight? F: Invite Kathy? She is the one who's planning the whole thing.", "id": "dev_645"}