datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
SCBench
SCBench
[Paper]
[Code]
[Project Page]
SCBench (SharedContextBench) is a comprehensive benchmark to evaluate efficient long-context methods in a KV cache-centric perspective, analyzing their performance across the full KV cache lifecycle (generation, compression, retrieval, and loading) in real-world scenarios where context memory (KV cache) is shared and reused across multiple requests.
🎯 Quick Start
Load Data
You can download and load the SCBench data… See the full description on the dataset page: https://huggingface.co/datasets/microsoft/SCBench.Taskbench
TaskBench: Benchmarking Large Language Models for Task Automation
Introduction
TaskBench is a benchmark for evaluating large language models (LLMs) on task automation. Task automation can be formulated into three critical stages: task decomposition, tool invocation, and parameter prediction. This complexity makes data collection and evaluation more challenging compared to common NLP tasks. To address this challenge, we propose a comprehensive evaluation framework… See the full description on the dataset page: https://huggingface.co/datasets/microsoft/Taskbench.bing_coronavirus_query_set
Dataset Card for BingCoronavirusQuerySet
Dataset Summary
Please note that you can specify the start and end date of the data. You can get start and end dates from here: https://github.com/microsoft/BingCoronavirusQuerySet/tree/master/data/2020
example:
load_dataset("bing_coronavirus_query_set", queries_by="state", start_date="2020-09-01", end_date="2020-09-30")
You can also load the data by country by using queries_by="country".
Supported Tasks and… See the full description on the dataset page: https://huggingface.co/datasets/microsoft/bing_coronavirus_query_set.benchpress-score-matrix
BenchPress Score Matrix
This dataset contains the public model-by-benchmark score matrix used by
BenchPress. The release includes the lossless audited JSON, benchmark cost
evidence, flat model and benchmark metadata, one row per observed score, and
the paper-canonical dense subset used in the BenchPress experiments.
The source repository is
microsoft/benchpress.
Canonical artifacts
data/llm_benchmark_data.json is the authoritative rich score-matrix artifact.
It… See the full description on the dataset page: https://huggingface.co/datasets/microsoft/benchpress-score-matrix.msr-acc-tae25
Microsoft Research - Accurate Chemistry Collection: Total Atomization Energies
Description
The Microsoft Research Accurate Chemistry Collection (MSR-ACC) provides a collection of accurate coupled cluster labels for training machine learning functionals.
MSR-ACC/TAE25 comprising 73,040 total atomization energies at the CCSD(T)/CBS level obtained with the W1-F12 thermochemical protocol.
The dataset is constructed to exhaustively cover the chemical space of closed-shell… See the full description on the dataset page: https://huggingface.co/datasets/microsoft/msr-acc-tae25.tspCoSAlign-Train
CoSAlign-Train: A Large-Scale Synthetic Training Dataset for Controllable Safety Alignment
Paper: Controllable Safety Alignment: Inference-Time Adaptation to Diverse Safety Requirements, published at ICLR 2025.
Purpose: Training dataset for controllable safety alignment (CoSA) of large language models (LLMs), facilitating fine-grained inference-time adaptation to diverse safety requirements.
Description: CoSAlign-Train is a large-scale, synthetic preference dataset designed for… See the full description on the dataset page: https://huggingface.co/datasets/microsoft/CoSAlign-Train.satdetails_microsoft__Phi-3-medium-4k-instruct
Dataset Card for Evaluation run of microsoft/Phi-3-medium-4k-instruct
Dataset automatically created during the evaluation run of model microsoft/Phi-3-medium-4k-instruct.
The dataset is composed of 136 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest… See the full description on the dataset page: https://huggingface.co/datasets/OALL/details_microsoft__Phi-3-medium-4k-instruct.libero-data-for-rhomicrosoft__Phi-3-medium-128k-instructmicrosoft__Phi-3-medium-4k-instructmicrosoft__Phi-3.5-MoE-instructmicrosoft__Phi-3-mini-128k-instructmicrosoft__phi-4details_microsoft__Phi-3.5-mini-instruct
Dataset Card for Evaluation run of microsoft/Phi-3.5-mini-instruct
Dataset automatically created during the evaluation run of model microsoft/Phi-3.5-mini-instruct.
The dataset is composed of 136 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.… See the full description on the dataset page: https://huggingface.co/datasets/OALL/details_microsoft__Phi-3.5-mini-instruct.details_microsoft__Phi-3-medium-128k-instruct
Dataset Card for Evaluation run of microsoft/Phi-3-medium-128k-instruct
Dataset automatically created during the evaluation run of model microsoft/Phi-3-medium-128k-instruct.
The dataset is composed of 136 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest… See the full description on the dataset page: https://huggingface.co/datasets/OALL/details_microsoft__Phi-3-medium-128k-instruct.microsoft__Phi-3-small-8k-instructmicrosoft__DialoGPT-mediummicrosoft__Phi-3-small-128k-instructNyxKrage__Microsoft_Phi-4microsoft__Phi-3-mini-4k-instructmicrosoft__Phi-3.5-mini-instructEvaluation_microsoft-mpnet-base