amazon/ShoppingReasoningBench

Shopping Reasoning Bench Conversational shopping assistants now serve hundreds of millions of customers, yet no existing benchmark jointly evaluates the open-ended multi-turn reasoning, domain expertise, and criterion-level quality that real shopping conversations demand. We introduce the Shopping Reasoning Bench, an expert-authored benchmark of 525 missions (232 single-turn, 293 multi-turn) with 10,863 importance-weighted binary rubrics authored by retail domain experts. These… See the full description on the dataset page: https://huggingface.co/datasets/amazon/ShoppingReasoningBench.