datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
NexusRaven_API_evaluation
NexusRaven API Evaluation dataset
Please see blog post or NexusRaven Github repo for more information.
License
The evaluation data in this repository consists primarily of our own curated evaluation data that only uses open source commercializable models. However, we include general domain data from the ToolLLM and ToolAlpaca papers. Since the data in the ToolLLM and ToolAlpaca works use OpenAI's GPT models for the generated content, the data is not commercially… See the full description on the dataset page: https://huggingface.co/datasets/Nexusflow/NexusRaven_API_evaluation.apigen-function-calling
Dataset card for argilla/apigen-function-calling
This dataset is a merge of argilla/Synth-APIGen-v0.1
and Salesforce/xlam-function-calling-60k, making
over 100K function calling examples following the APIGen recipe.
Prepare for training
This version is not ready to do fine tuning, but you can run a script like prepare_for_sft.py
to prepare it, and run the same recipe that can be found in
argilla/Llama-3.2-1B-Instruct-APIGen-FC-v0.1#training-procedure.
Modify the prompt… See the full description on the dataset page: https://huggingface.co/datasets/argilla/apigen-function-calling.APIGen-MT-5k
Summary
APIGen-MT is an automated agentic data generation pipeline designed to synthesize verifiable, high-quality, realistic datasets for agentic applications
This dataset was released as part of APIGen-MT: Agentic PIpeline for Multi-Turn Data Generation via Simulated Agent-Human Interplay
Code: https://github.com/apigen-mt/apigen-mt.github.io
The repo contains 5000 multi-turn trajectories collected by APIGen-MT
This dataset is a subset of the data used to train the xLAM-2 model… See the full description on the dataset page: https://huggingface.co/datasets/Salesforce/APIGen-MT-5k.openai-moderation-api-evaluation
Evaluation dataset for the paper "A Holistic Approach to Undesired Content Detection"
The evaluation dataset data/samples-1680.jsonl.gz is the test set used in this paper.
Each line contains information about one sample in a JSON object and each sample is labeled according to our taxonomy. The category label is a binary flag, but if it does not include in the JSON, it means we do not know the label.
Category
Label
Definition
sexual
S
Content meant to arouse sexual… See the full description on the dataset page: https://huggingface.co/datasets/mmathys/openai-moderation-api-evaluation.Synth-APIGen-v0.1
Dataset card for Synth-APIGen-v0.1
This dataset has been created with distilabel.
Pipeline script: pipeline_apigen_train.py.
Dataset creation
It has been created with distilabel==1.4.0 version.
This dataset is an implementation of APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasets in distilabel,
generated from synthetic functions. The process can be summarized as follows:
Generate (or in this case modify) python… See the full description on the dataset page: https://huggingface.co/datasets/argilla/Synth-APIGen-v0.1.APIGen-MT-5k-with-cot-v1-deepseek_deepseekdeepseek-v2-codder-minecraft-apiFINDER_API_KEY_AI_SEARCH_2023
FINDER_API_KEY_AI_SEARCH_2023
tags: data collection, machine learning, API performance
Note: This is an AI-generated dataset so its content may be inaccurate or false
Dataset Description:
The 'FINDER_API_KEY_AI_SEARCH_2023' dataset is designed to collect and analyze data from various AI search engines and their associated API performance metrics. The dataset focuses on the effectiveness of API key-based access in enhancing the search capabilities of AI systems and includes a… See the full description on the dataset page: https://huggingface.co/datasets/infinite-dataset-hub/FINDER_API_KEY_AI_SEARCH_2023.apigen-smollm-trl-FC
Dataset card for argilla-warehouse/apigen-smollm-trl-FC
This dataset is a merge of argilla/Synth-APIGen-v0.1
and Salesforce/xlam-function-calling-60k, and was prepared for training using the script
prepare_for_sft.py that can be found in the repository files.
References
@article{liu2024apigen,
title={APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasets},
author={Liu, Zuxin and Hoang, Thai and Zhang, Jianguo and Zhu, Ming and… See the full description on the dataset page: https://huggingface.co/datasets/argilla-warehouse/apigen-smollm-trl-FC.synth-apigen-qwen-exec
Dataset Card for synth-apigen-qwen-exec
This dataset has been created with distilabel.
The pipeline script was uploaded to easily reproduce the dataset:
apigen_exec.py.
It can be run directly using the CLI:
distilabel pipeline run --script "https://huggingface.co/datasets/plaguss/synth-apigen-qwen-exec/raw/main/apigen_exec.py"
Dataset Summary
This dataset contains a pipeline.yaml which can be used to reproduce the pipeline that generated it in… See the full description on the dataset page: https://huggingface.co/datasets/plaguss/synth-apigen-qwen-exec.black-box-api-challenges
Dataset Card
Paper: On the Challenges of Using Black-Box APIs for Toxicity Evaluation in Research
Abstract: Perception of toxicity evolves over time and often differs between geographies and cultural backgrounds. Similarly, black-box commercially available APIs for detecting toxicity, such as the Perspective API, are not static, but frequently retrained to address any unattended weaknesses and biases. We evaluate the implications of these changes on the reproducibility of findings… See the full description on the dataset page: https://huggingface.co/datasets/CohereLabs/black-box-api-challenges.ai-api-pricing
AI API Pricing Dataset
This Hugging Face dataset is the machine-readable distribution of the public AI API pricing records published by AICostBudget. It is not a separately curated subset: train.csv, prices.csv, and prices.json are generated from the same Pricing V2 public projection used by the AICostBudget Dataset page and download APIs.
Prices change frequently. Verify production billing decisions against the provider pricing page, contract, billing dashboard, and invoice.… See the full description on the dataset page: https://huggingface.co/datasets/aicostbudget-ai/ai-api-pricing.synth-apigen-qwen
Dataset Card for argilla-warehouse/synth-apigen-qwen
This dataset has been created with distilabel.
The pipeline script was uploaded to easily reproduce the dataset:
synth_apigen.py.
Dataset creation
This dataset is a replica in distilabel of the framework
defined in: APIGen: Automated Pipeline for Generating Verifiable and Diverse Function-Calling Datasets.
Using the seed dataset of synthetic python functions in argilla-warehouse/python-seed-tools,
the… See the full description on the dataset page: https://huggingface.co/datasets/argilla-warehouse/synth-apigen-qwen.django-rest-api-2024apigen-synth-trl
Dataset card
This dataset is a version of argilla/Synth-APIGen-v0.1 prepared for
fine-tuning using trl. To generate it, the following script was run:
from datasets import load_dataset
from jinja2 import Template
SYSTEM_PROMPT = """
You are an expert in composing functions. You are given a question and a set of possible functions.
Based on the question, you will need to make one or more function/tool calls to achieve the purpose.
If none of the functions can be used, point it out… See the full description on the dataset page: https://huggingface.co/datasets/argilla-warehouse/apigen-synth-trl.Open-Router-API-Pricing-Analysis
OpenRouter API Pricing Analysis Dataset
Overview
This dataset provides a point-in-time capture of pricing and parameters for LLMs available through the OpenRouter API for inference.
Contents
Raw Data (raw/)
Contains the original data extracted from the OpenRouter API, including:
Model pricing (input/output token costs)
Model parameters and specifications
Computed fields such as output/input token price ratios
Enhanced Data (hf-enhanced/)… See the full description on the dataset page: https://huggingface.co/datasets/danielrosehill/Open-Router-API-Pricing-Analysis.starcoderdata-apisstarcoder-apis-2api_audit_dataThis repository contains code for auditing Large Language Models (LLMs) to verify service integrity, as described in the paper Are You Getting What You Pay For? Auditing Model Substitution in LLM APIs.
Github repository: https://github.com/willsdca/llm_api_audit
synth-apigen-llama-exec
Dataset Card for synth-apigen-llama-exec
This dataset has been created with distilabel.
The pipeline script was uploaded to easily reproduce the dataset:
apigen_exec.py.
It can be run directly using the CLI:
distilabel pipeline run --script "https://huggingface.co/datasets/plaguss/synth-apigen-llama-exec/raw/main/apigen_exec.py"
Dataset Summary
This dataset contains a pipeline.yaml which can be used to reproduce the pipeline that generated it in… See the full description on the dataset page: https://huggingface.co/datasets/plaguss/synth-apigen-llama-exec.starcoder-apis-1apigen-tau-bench-split-turnstarcoder-apis-0hermes_salesforce_apigen_tool_useAPIGen-50k50,000 samples from argilla/apigen-function-calling
SQL-API-Bench
Dataset Card for Dataset Name
This dataset contains QA that requires DB and API access at the same time. It is composed of two new benchmarks consisting of questions whose answers require a
combination of database and API calls, both of
which are augmentations of the popular Spider
dataset and benchmark.
Benchmark I replaces a fraction of the real Spider database tables with
equivalents that are executed via APIs. This allows us to directly test the mechanism by which
database and… See the full description on the dataset page: https://huggingface.co/datasets/ibm-research/SQL-API-Bench.oauth-api-security-en
OAuth & API Security Dataset (EN)
Comprehensive English dataset covering OAuth 2.0 vulnerabilities, API attacks (OWASP API Top 10 2023), security controls, and Q&A pairs for training cybersecurity-specialized language models.
Dataset Contents
Category
Entries
Description
OAuth 2.0 Vulnerabilities
20
Authorization Code Interception, CSRF, PKCE bypass, JWT attacks, token leakage
API Attacks
25
BOLA, BFLA, BOPLA, SSRF, GraphQL DoS, gRPC injection, CORS… See the full description on the dataset page: https://huggingface.co/datasets/AYI-NEDJIMI/oauth-api-security-en.BLaIR-Bench-APItpex-api-call-reasoning-1k
TPEx OpenAPI Function-Calling Reasoning (1K)
繁體中文的 function-calling 推理 SFT 資料集,共 1,000 筆。任務情境圍繞**台灣證券櫃檯買賣中心(TPEx,櫃買中心)**的開放資料查詢——上櫃股票行情、櫃買指數、權證、國際債券、ESG/財報揭露、公司基本資料等。
工具取自 TPEx 官方 OpenAPI,且每一筆樣本的工具呼叫都實際對 TPEx API 發出並驗證成功。每筆包含使用者任務(中英雙語)、繁體中文思考鏈(think)、對應的 function call(answer),以及可直接 SFT 的 Hermes 格式 messages。格式對齊 twinkle-ai/tw-function-call-reasoning-10k。
資料來源與生成方式
工具來源:TPEx 證券櫃檯買賣中心官方 OpenAPI(https://www.tpex.org.tw/openapi/swagger.json),涵蓋 120… See the full description on the dataset page: https://huggingface.co/datasets/Simon-Liu/tpex-api-call-reasoning-1k.ClinFuseDiff-APIS-Data
APIS Stroke Dataset - Preprocessed (Lesion Cases Only)
This dataset contains 54 acute ischemic stroke cases with expert lesion annotations from the APIS dataset.
Dataset Structure
preproc/
train_000/
ct.nii.gz # CT scan
mri.nii.gz # Registered MRI (ADC)
brain_mask.nii.gz # Brain ROI mask (TotalSegmentator)
bone_mask.nii.gz # Bone/skull ROI mask (TotalSegmentator)
lesion_mask.nii.gz # Expert-annotated… See the full description on the dataset page: https://huggingface.co/datasets/hamsanaik/ClinFuseDiff-APIS-Data.