mlx-community/ToolMind

ToolMind: A Large-Scale, Reasoning-Enhanced Tool-Use Dataset

ToolMind is a large-scale, high-quality tool-agentic dataset with 160k synthetic data instances generated using over 20k tools and 200k augmented open-source data instances. Our data synthesis pipeline first constructs a function graph based on parameter correlations and then uses a multi-agent framework to simulate realistic user–assistant–tool interactions. Beyond trajectory-level validation, we employ fine-grained turn-level filtering to remove erroneous or suboptimal steps, ensuring that only high-quality reasoning traces are retained.

• —Technical Report - https://arxiv.org/abs/2511.15718

<img src="./figures/toolmind_performance.png" width="800"/>

Synthesis pipeline

<img src="./figures/ToolMind.png" width="600"/>

• —Graph Construction and Function Chain Sampling

• —We construct a directed graph over the collected functions to model their input–output compatibility, and then sample function chains via random walks for trajectory synthesis.

• —Multi-Agent Multi-Turn Trajectory Synthesis

• —We synthesize user intents to represent realistic user goals. And then the trajectories are created through a multi-agent simulation that involves three distinct agents.

• —Quality Filtering

• —To ensure that the synthesized interactions provide reliable learning signals, we apply a two-stage quality filtering process: trajectory-level filtering that maintains goal alignment and coherence, followed by turn-level filtering that removes erroneous or misaligned steps.

• —Hybrid Training with Augmented Open-Source Data
• —We also incorporat a large amount of processed open-source data, including xlam-function-calling-60k, When2Call, glaive-function-calling-v2, ToolACE, BUTTONInstruct, APIGen-MT-5k, Tau-bench training set. The processing steps involved quality filtering and response reconstruction.
• —All open-source multi-turn datasets are subjected to the same split and quality-filtering procedures as the synthesised data.

Dataset Statistic

• —We split each trajectory into multiple samples using the turns that passed the turn-level quality filter and analyze both trajectories (orange) and post-split samples (blue).

<img src="./figures/combined_analysis.png" width="800"/>

• —Domain Statistics

<img src="./figures/domain_pie.png" width="500"/>

Overall Performance

• —BFCL-v4 2510

• —τ-bench and τ²-bench (For τ²-bench evaluation, we use gpt-4o to act as the user)

Ablation Study

Limitations

While we place great emphasis on the safety of the model during the training process, striving to ensure that its outputs align with ethical and legal requirements, it may not completely avoid generating unexpected outputs due to the model's size and probabilistic nature. These outputs may include harmful content such as bias or discrimination. Please don't propagate such content. We do not assume any responsibility for the consequences resulting from the dissemination of inappropriate information.

Citation

If you find our verifiers useful or want to use it in your projects, please kindly cite this Huggingface project.

<pre><code> @misc{yang2025toolmindtechnicalreportlargescale, title={ToolMind Technical Report: A Large-Scale, Reasoning-Enhanced Tool-Use Dataset}, author={Chen Yang and Ran Le and Yun Xing and Zhenwei An and Zongchao Chen and Wayne Xin Zhao and Yang Song and Tao Zhang}, year={2025}, eprint={2511.15718}, archivePrefix={arXiv}, primaryClass={cs.AI}, url={https://arxiv.org/abs/2511.15718}, } </code></pre>

Other Information

If you have any questions, please raise an issue or contact us at nanbeige@126.com.