qualifire/tool-selection-quality-benchmark

Tool Selection Quality Benchmark A benchmark for evaluating whether an LLM correctly judges the quality of a tool call / function call made by another model - i.e. given a user request, the tools available, and the model's resulting function call (or direct reply), did the model pick the right tool and fill it in correctly? Each row is one turn to be judged: a message history ending in either a function call or a direct assistant response, paired with the set of tools that were… See the full description on the dataset page: https://huggingface.co/datasets/qualifire/tool-selection-quality-benchmark.