datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
stabletoolbench
StableToolBench tool-use trajectories
This dataset contains Ergon-native sharded rollout-card exports for the paper artifact.
Evidence type: Full multi-step trace.
This export includes inspectable multi-step process evidence for rollout-card review.
Source URL: https://github.com/THUNLP-MT/StableToolBench
License: See upstream repository
Redistribution class: metadata-plus-fetch
Card claim class: preservation
Public evidence class: multi_step_trace
Reducer paper result ids:… See the full description on the dataset page: https://huggingface.co/datasets/annon124816/stabletoolbench.CacheThis is the cache and tools folder used in StableToolBench.
ToolEnv2404This is the tool set of we crawled in Apr 2404 in the ToolBench format and used to train the StableToolBench-Mirror API model. To use this tool set, download the .tar.gz file and unzip it with tar xzvf toolenv2404_filtered.tar.gz and copy the path of the tools folder in the running script of ToolBench. For example,
export TOOLBENCH_KEY=""
export OPENAI_KEY=""
export OPENAI_API_BASE=""
export PYTHONPATH=./
export GPT_MODEL="gpt-3.5-turbo-16k"
export SERVICE_URL="http://localhost:8080/virtual"… See the full description on the dataset page: https://huggingface.co/datasets/stabletoolbench/ToolEnv2404.MirrorAPI-Bench
MirrorAPI-Bench dataset
This dataset contains the following resources:
The testing data for MirrorAPI and MirrorAPI-Cache:
test_sft/: The testing data for MirrorAPI with SFT prompts.
test_cot/: The testing data for MirrorAPI with CoT prompts.
reference/: The references for testing data without JSON format. These references are used for evaluation. Note that cache.jsonl has only 200 random samples from test_cache.json.
test_cache.json: The testing data for MirrorAPI-Cache.… See the full description on the dataset page: https://huggingface.co/datasets/stabletoolbench/MirrorAPI-Bench.MirrorAPI-Training
MirrorAPI training dataset
This dataset contains the training data for MirrorAPI and MirrorAPI-Cache:
train_sft.json, train_cot.json, train_augment.json: The training data for MirrorAPI .
train_cache.json: The training data for MirrorAPI-Cache.
StableToolBench_databaselinesThis is the baselines used to produce the performance in StableToolBench.
real_simulated_compareThis a new test set for comparing real and simulated APIs in StableToolBench-MirrorAPI. This dataset is in the ToolBench/StableToolBench test set format and you can directly use it in ToolBench or StableToolBench.
stabletoolbench
StableToolBench tool-use trajectories
This dataset contains exported rollout-card bundle JSONL files for the paper artifact.
Source URL: https://github.com/THUNLP-MT/StableToolBench
License: See upstream repository
Redistribution class: metadata-plus-fetch
Card claim class: preservation
Reducer paper result ids: none