cesun/When2Tool

When2Tool Benchmark dataset for "LLM Agents Already Know When to Call Tools — Even Without Reasoning" (arXiv:2605.09252). Overview When2Tool is a benchmark of 18 environments designed to study when LLM agents should call tools. Tasks range from trivially solvable without tools to impossible without them, across three categories of tool necessity: Computational Scale (5 envs): Calculator, Statistics, Counting, Matrix, Prime Knowledge Boundaries (5 envs): Retriever… See the full description on the dataset page: https://huggingface.co/datasets/cesun/When2Tool.