datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
discoverybenchData-driven Discovery Benchmark from the paper:
"DiscoveryBench: Towards Data-Driven Discovery with Large Language Models"
🔭 Overview
DiscoveryBench is designed to systematically assess current model capabilities in data-driven discovery tasks and provide a useful resource for improving them. Each DiscoveryBench task consists of a goal and dataset(s). Solving the task requires both statistical analysis and semantic reasoning. A faceted evaluation allows open-ended… See the full description on the dataset page: https://huggingface.co/datasets/allenai/discoverybench.discoverybench
DiscoveryBench - Alias
A reformatted version of the original DiscoveryBench dataset for easier usage.
🤗 Original Dataset on HF
💻 GitHub Repository
📄 Paper (arXiv)
📁 Dataset Structure
The dataset consists of real and synthetic subsets:
Real Splits:
real_train
real_test
Synthetic Splits:
synth_train
synth_dev
synth_test
Each split contains a list of tasks with references to associated CSV datasets needed to answer the query. LLMs are expected to use the… See the full description on the dataset page: https://huggingface.co/datasets/nhop/discoverybench.red-pill-drug-discovery-formulation
🔴 RED-PILL
Research Enhanced Dataset for Pharmaceutical Innovation in Learning & Language
The first open instruction-tuning dataset for drug discovery & formulation development.
Built for fine-tuning Heretic-ablated models that won't refuse your pharmaceutical R&D questions.
⚡ Quick Start
from datasets import load_dataset
# Load the full dataset
ds = load_dataset("saidutta69/red-pill-drug-discovery-formulation"… See the full description on the dataset page: https://huggingface.co/datasets/saidutta69/red-pill-drug-discovery-formulation.discover-and-prove
MiniF2F-Hard & FIMO-Hard
Expert-reannotated Hard Mode variants of the MiniF2F and FIMO theorem-proving
benchmarks, released with our paper Discover and Prove: An Open-source Agentic
Framework for Hard Mode Automated Theorem Proving in Lean 4 (ACL 2026).
In Hard Mode, the final answer is not embedded in the formal statement:
the system must first discover the answer before constructing a formal proof —
mirroring what a human competitor actually faces. Each solution-style… See the full description on the dataset page: https://huggingface.co/datasets/liuchengwu/discover-and-prove.DiscoverLLM-multiturn-preferences
DiscoverLLM: Multi-turn Preference Dataset
Multi-turn dialogue data with scored candidate completions, produced by best-of-N
synthesis over the DiscoverLLM user simulator
(paper · project page).
Each example is a single turn of a simulated user–assistant conversation with one of
several candidate assistant responses and an associated reward score, intended for
offline DPO / GRPO / reward-model training.
Configs
Config
Rows
Task
creative_writing
3,052… See the full description on the dataset page: https://huggingface.co/datasets/kixlab/DiscoverLLM-multiturn-preferences.cleo-value-discovery
Cleo Value-Discovery Benchmark
A small (66-question), held-out benchmark for a failure mode that ordinary text-to-SQL evaluations miss:
questions whose correct SQL depends on a literal that lives in the data, not the schema.
The schema tells you a column is named status; only the data reveals its values are {'O','C','X'}.
The schema shows to_date; only the data reveals that "current" is encoded as the sentinel
'9999-01-01'. A one-shot text-to-SQL model has to guess these… See the full description on the dataset page: https://huggingface.co/datasets/dreeseaw/cleo-value-discovery.hf-coding-tools-dashboard-discovery
HuggingFace AI Coding Tools Dashboard
Benchmark data from the HuggingFace AI Dashboard — tracking how AI coding tools (Claude Code, Codex, Copilot, Cursor) recommend HuggingFace products across 32 developer categories.
Dataset Structure
Split
Description
Rows
results
Full benchmark results with LLM responses, cost, tokens, latency, and product detection
9022
queries
Benchmark query definitions across 32 categories
284
runs
Run metadata and tool/model… See the full description on the dataset page: https://huggingface.co/datasets/davidkling/hf-coding-tools-dashboard-discovery.ai-drug-discovery-papers
AI for Drug Discovery Papers — FineSet
A research-paper dataset on AI for Drug Discovery Papers, assembled, deduplicated, and quality-scored by
FineSet from arXiv and Semantic Scholar.
📸 This is a dated snapshot — generated 2026-06-19.
It is not auto-updated. Research on AI for Drug Discovery Papers moves fast — new papers land on arXiv every
week. Want this same dataset refreshed daily, on a topic you choose? See the bottom. ↓
Why this dataset
Quality-scored:… See the full description on the dataset page: https://huggingface.co/datasets/fineset-io/ai-drug-discovery-papers.API_Discovery_Retrieval_Augmented_Calling
🇰🇿 Kazakh API Discovery and Tool Retrieval Dataset
Dataset Summary
Kazakh API Discovery and Tool Retrieval Dataset is a Kazakh-language dataset designed for training and evaluating Large Language Models (LLMs) in agentic AI workflows that require API discovery, tool documentation retrieval, function calling, and multi-step tool execution.
The dataset focuses on scenarios where the assistant must first inspect or retrieve API documentation before calling the… See the full description on the dataset page: https://huggingface.co/datasets/farabi-lab/API_Discovery_Retrieval_Augmented_Calling.