datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
vllm-control-arena
vLLM Main Tasks Dataset
AI coding tasks generated from vLLM git commits
Dataset Description
This dataset contains 6801 coding tasks automatically generated from git commits in the vLLM repository. Each task represents a real-world coding challenge derived from actual development work.
Dataset Structure
The dataset contains the following columns:
commit_hash: The git commit hash
parent_hash: The parent commit hash
commit_title: The original commit… See the full description on the dataset page: https://huggingface.co/datasets/RoganInglis/vllm-control-arena.spreadsheet-arena-release
Spreadsheet Arena
A dataset of 555 pairwise human preference votes over LLM-generated spreadsheets, spanning 124 distinct user-submitted prompts and 17 models.
This is the public release accompanying the Spreadsheet Arena paper.
Contents
battles.csv
models.csv
outputs/<id>/
sheet.json
sheet.xlsx
<id> is a 16-char hex identifier (HMAC-SHA256 of an internal UUID under a… See the full description on the dataset page: https://huggingface.co/datasets/Longitude-Labs/spreadsheet-arena-release.CXM_Arena
Dataset Card for CXM Arena Benchmark Suite
Dataset Description
This dataset, "CXM Arena Benchmark Suite," is a comprehensive collection designed to evaluate various AI capabilities within the Customer Experience Management (CXM) domain. It consolidates five distinct tasks into a unified benchmark, enabling robust testing of models and pipelines in business contexts. The entire suite was synthetically generated using advanced large language models, primarily… See the full description on the dataset page: https://huggingface.co/datasets/sprinklr-huggingface/CXM_Arena.m-ArenaHard-v2.0
Dataset Card for m-ArenaHard-v2.0
This dataset is used in the paper When Life Gives You Samples: The Benefits of Scaling up Inference Compute for Multilingual LLMs.
Dataset Details
The m-ArenaHard-v2.0 dataset is a multilingual LLM evaluation set. This is built on the LMarena (formerly LMSYS) arena-hard-auto-v2.0 test dataset.
This dataset(containing 750 prompts) was filtered to "english" only prompts using the papluca/xlm-roberta-base-language-detection model resulting… See the full description on the dataset page: https://huggingface.co/datasets/CohereLabs/m-ArenaHard-v2.0.m-ArenaHard-v2.1
Dataset Card for m-ArenaHard-v2.1
The m-ArenaHard-v2.1 dataset is a multilingual LLM evaluation set built from the LMarena arena-hard-auto-v2.0 prompts used in m-ArenaHard-v2.0. It keeps the public v2.0 row schema while expanding coverage to the 67 raw translation files produced for the Tiny Aya evaluation work.
The dataset includes 67 languages:
am, ar, bg, bn, ca, cs, cy, da, de, el, en, es, et, eu, fa, fi, fr, ga, gl, gu, ha, he, hi, hr, hu, id, ig, it, ja, jv, km, ko, lo, lt, lv… See the full description on the dataset page: https://huggingface.co/datasets/CohereLabs/m-ArenaHard-v2.1.CK-Arena
CK-Arena Dataset
Overview
This is the official dataset for CK-Arena, a multi-agent benchmark designed to evaluate whether large language models (LLMs) truly master concept-level knowledge.
CK-Arena operationalises concept understanding through a language-based social deduction game (Undercover): LLM players receive closely related word concepts and must describe their assigned concept naturally, while LLM judges score each statement. By running many games… See the full description on the dataset page: https://huggingface.co/datasets/Xushuhaha/CK-Arena.refund-arena
Refund Arena
Gold for a helpdesk agent that pays. Used by Refund Arena to score whether money left that should not have left this turn.
A customer asks for a refund the policy does not allow. The agent closes the ticket and calls issue_refund. Support now owes money or has to claw it back. I do not ship if that write happens.
This dataset is text JSONL only. Card images live on GitHub (docs/assets/). They are not a split. Do not load this repo as ImageFolder.
Hugging… See the full description on the dataset page: https://huggingface.co/datasets/martincousseau/refund-arena.research-ideation-arena-dataset
Research Ideation
This repository contains the public data payload for the Research Ideation benchmark, presented in the paper Ideation Arena: Evaluating LLM Generated Research Ideas with Battle-style Human Expert Assessment. The code is available at https://github.com/foss12138/Research-Ideation-Arena.
Files
final_ideation_results_with_response.json
Final pairwise ideation evaluation records with released responses.
queries.json
Query definitions used by the… See the full description on the dataset page: https://huggingface.co/datasets/yolo1213811/research-ideation-arena-dataset.comparia-fr-arena
comparia-fr-arena: French-language conversations and human preferences
Compar:IA is a public chatbot arena run by the French Ministry of Culture. People chat with two anonymous models side by side and say which answer they prefer. This dataset is the result.
Each row is one turn of a conversation: the two models' answers to the same user message, the preference the user gave on that turn (if any), and the full conversation both answers belong to. The prompts come… See the full description on the dataset page: https://huggingface.co/datasets/ministere-culture/comparia-fr-arena.research-ideation-arena-si-rm
Research Ideation Arena — Scientific Ideation RM Splits
Derived from Research Ideation Arena, revision f5704385bd66781d504e44810a9a8b56c1623b7a.
Original authors: Zhiyu Chen et al. See the paper and official code.
Splits and evaluation caveat
Train: 3,047 preference pairs. Test: 500 fixed preference pairs.
All remaining pairs from the 3,547-pair filtered pool are assigned to training.
Exact sample/pair overlap is zero, but 607 training rows share a connected… See the full description on the dataset page: https://huggingface.co/datasets/tintin1027/research-ideation-arena-si-rm.swarm-arena-sft-v2
Swarm Arena SFT v2
Solver-filtered warm-start data for the deterministic Swarm Arena 4v4
coordination environment. Each row contains system, user, and assistant messages
plus provenance metadata. Training broadcasts and actions are separate splits so
sampling can preserve a 60/40 phase mixture. Validation and test are never
reweighted.
The simulator, oracle, audit, frozen evaluation, and Prime-RL configs live in… See the full description on the dataset page: https://huggingface.co/datasets/CK0607/swarm-arena-sft-v2.Arena-Write
📚 Arena-Write Dataset
Arena-Write is a small-scale benchmark of 100 user writing tasks, designed to evaluate long-form generation models in realistic scenarios. Each task covers diverse formats such as social posts, essays, and reports, with many requiring outputs over 2,000 words.
Project page: https://huggingface.co/THU-KEG/
📄 Data Format
Each data sample is a JSON object with the following fields:
{
"idx": 1,
"question": "Write a social media post about Lei Feng… See the full description on the dataset page: https://huggingface.co/datasets/THU-KEG/Arena-Write.cje-chatbot-arena
CJE Chatbot Arena Dataset
Dataset from Causal Judge Evaluation experiments on Chatbot Arena data.
Dataset Structure
cje_dataset.jsonl - Main dataset with judge scores and oracle labels (4,961 prompts)
prompts.jsonl - Original Chatbot Arena prompts
responses/ - Model responses for each policy variant
logprobs/ - Token logprobs for importance sampling estimators
Policies
5 system prompt variants evaluated:
base - No system prompt
clone - "Respond exactly as… See the full description on the dataset page: https://huggingface.co/datasets/elandy/cje-chatbot-arena.lmsys-arena-human-preference-winner-43k-unfiltered
lmsys-arena-human-preference-winner-43k-unfiltered
This repository contains a dataset derived from the lmsys/lmsys-arena-human-preference-55k dataset, which is licensed under the Apache 2.0 License.
Dataset Description
The lmsys-arena-human-preference-winner-43k-unfiltered dataset is a collection of 43,000 samples, each containing an instruction (prompt) and an output (winning response) from real-world user and LLM conversations. The dataset is derived from the original… See the full description on the dataset page: https://huggingface.co/datasets/lesserfield/lmsys-arena-human-preference-winner-43k-unfiltered.ko-arena-hard-auto-v0.1
Ko-Arena-Hard-Auto
한국어 / English
리더보드 / 코드
ko-arena-hard-auto-v0.1는 한국어를 벤치마킹하기위한 자동 평가 도구의 질문 데이터셋입니다.
인간의 선호도와 높은 상관관계와 분리력을 가지고 있는 벤치마크 데이터셋인 arena-hard-auto-v0.1 를 GPT-4o와 o1을 사용하여 한국어로 번역하고 수작업으로 검수한 데이터셋입니다.
더 자세한 세부사항과 벤치마킹 결과는 ko-arena-hard-auto 코드를 참조하세요.
또한 원본 벤치마크에 관심이 있으시면 arena-hard-auto 코드를 참조하세요.
원래 문제의 형식을 유지하기 힘들어서 변경했습니다.
인덱스 : 1, 28, 29
문제를 한국어로 유도하기 위해 문제 형식을 변경했습니다. 원래는 코드만 존재합니다.
인덱스 : 30, 379, 190
참고문헌:
@article{li2024crowdsourced,
title={From Crowdsourced… See the full description on the dataset page: https://huggingface.co/datasets/qwopqwop/ko-arena-hard-auto-v0.1.llm-jp-chatbot-arena-conversations
LLM-jp Chatbot Arena Conversations Dataset
This dataset contains approximately 1,000 conversations with pairwise human preferences, most of which are in Japanese.
The data was collected during the trial phase of the LLM-jp Chatbot Arena (January–February 2025), where users compared responses from two different models in a head-to-head format.
Each sample includes a question ID, the names of the two models, their conversation transcripts, the user's vote, an anonymized user ID, a… See the full description on the dataset page: https://huggingface.co/datasets/llm-jp/llm-jp-chatbot-arena-conversations.rag-qa-arena
RAG QA Arena Annotated Dataset
A comprehensive multi-domain question-answering dataset with citation annotations designed for evaluating Retrieval-Augmented Generation (RAG) systems, featuring faithful answers with proper source attribution across 6 specialized domains.
🎯 Dataset Overview
This annotated version of the RAG QA Arena dataset includes citation information and gold document IDs, making it ideal for evaluating not just answer accuracy but also answer grounding… See the full description on the dataset page: https://huggingface.co/datasets/rajistics/rag-qa-arena.cc-arena-dataset
CC-Arena Benchmark Dataset
Full benchmark datasets for CC-Arena — a framework for evaluating AI coding agents (Claude Code, Cursor, etc.).
Quick Start
Via CC-Arena CLI (recommended)
# Download a specific benchmark
python3 -m cc_arena.tasks.downloader download humaneval
# Download with limit
python3 -m cc_arena.tasks.downloader download bigcodebench --limit 100
# List all available benchmarks
python3 -m cc_arena.tasks.downloader list
Via… See the full description on the dataset page: https://huggingface.co/datasets/songjhPKU/cc-arena-dataset.local-code-arena-deepseek-r1_1.5b
Local Code Arena Telemetry: MBPP Benchmark on DeepSeek R1 1.5B
This repository hosts the raw evaluation metrics, execution telemetry logs, and structural syntax outputs captured from running the Mostly Basic Python Problems (MBPP) benchmark against the DeepSeek R1 1.5B distilled reasoning architecture.
This specific run establishes the performance boundaries of lightweight reasoning models under strict execution time limits on consumer hardware.
📊 Core Performance… See the full description on the dataset page: https://huggingface.co/datasets/ShahzebKhoso/local-code-arena-deepseek-r1_1.5b.ko-arena-hard-v2
ko-arena-hard-v2
Korean adaptation of arena-hard-v2, an LMSYS-style head-to-head benchmark where a strong judge model rates a candidate model's answer against a fixed baseline answer.
491 prompts in Korean, drawn from CohereLabs/m-ArenaHard-v2.0 (config ko)
Frozen baselines generated by gpt-5-mini with category-specific reasoning effort
Recommended judge: gpt-4.1 via the upstream arena_judge pipeline (dual A↔B scoring)
Schema
Field
Type
Description… See the full description on the dataset page: https://huggingface.co/datasets/nlee-208/ko-arena-hard-v2.local-code-master_telemetry_arena
Local Code Arena: Comprehensive Telemetry Matrix Dataset
🏆 An Empirical Dataset tracking Local Generation Throughput (TPS), Real-Time Latency, Syntactic CodeBLEU Alignments, and Functional Pass Rates across 22 Edge Architectures.
📊 Dataset Blueprint
This dataset contains a consolidated, high-fidelity matrix of 11,000 unique token-generation execution loops across 22 state-of-the-art open-weights language models (ranging from 500M to 15.5B parameters). Every… See the full description on the dataset page: https://huggingface.co/datasets/ShahzebKhoso/local-code-master_telemetry_arena.EldenRingQA
🗡️ Elden Ring QA Dataset
A domain-specific question-answering dataset for Elden Ring, covering weapons, bosses, armors, spells, NPCs, locations, creatures, skills, and ashes of war — including cross-entity boss vulnerability analysis and per-build weapon recommendations.
Uses
Intended Uses
Fine-tuning language models for Elden Ring domain-specific QA
Training instruction-following models on structured game knowledge
Retrieval-augmented generation (RAG)… See the full description on the dataset page: https://huggingface.co/datasets/ArenaRune/EldenRingQA.local-code-arena-eval_results_deepseek-r1_8b
Local Code Arena Telemetry: MBPP Benchmark on DeepSeek R1 8B
This repository hosts the raw evaluation metrics, execution telemetry logs, and structural syntax outputs captured from running the Mostly Basic Python Problems (MBPP) benchmark against the DeepSeek R1 8B distilled reasoning architecture.
This specific run establishes the operational baseline and performance characteristics of mid-tier reasoning models under strict automated evaluation and sandbox time limits on… See the full description on the dataset page: https://huggingface.co/datasets/ShahzebKhoso/local-code-arena-eval_results_deepseek-r1_8b.nanbeige4-3b-thinking-2511_arena-hard-creative-writing
Nanbeige/Nanbeige4-3B-Thinking-2511 — arena-hard-creative-writing
Model outputs from the micro-creativity inference suite.
Model: Nanbeige/Nanbeige4-3B-Thinking-2511
Dataset: arena-hard-creative-writing (250 items)
Part of collection: ZachW/llm-creativity-benchmarks
Generation config
temperature: 0.0
max_tokens: 16384
seed: 42
backend: vllm
Columns
Column
Description
task_id
Unique task identifier
input
The exact prompt sent… See the full description on the dataset page: https://huggingface.co/datasets/ZachW/nanbeige4-3b-thinking-2511_arena-hard-creative-writing.arena-poker-reasoned-decisions-v0
DevFun Arena Poker - Reasoned Decision Traces (v0)
1000 agent decision traces from live 6-max No-Limit Texas Hold'em on the
dev.fun AI-agent poker Arena. Each row is one agent's decision at one
moment in one hand, paired with the structured rationale the agent emitted for that action.
This is a small curated SAMPLE for researchers to judge whether the full data is useful.
Each decision is enriched with full per-seat table state (every seat's stack at decision time),
all-in… See the full description on the dataset page: https://huggingface.co/datasets/dannyobito/arena-poker-reasoned-decisions-v0.ko-arena-hard-auto-v0.1qwopqwop님이 ko-arena-hard를 번역하신 데이터 qwopqwop/ko-arena-hard-auto-v0.1에 tag를 단 데이터입니다.
tag 정보
Category
Count
Description
Coding & Debugging
279
Users seek help with writing, reviewing, or fixing code in programming.
Planning
67
Users need assistance in creating plans or strategies for activities and projects.
Data analysis
31
Requests involve interpreting data, statistics, or performing analytical tasks.
Math
26
Queries related to mathematical concepts, problems, and… See the full description on the dataset page: https://huggingface.co/datasets/nwirandx/ko-arena-hard-auto-v0.1.local-code-arena-mbpp-deepseek-coder_6.7b
Local Code Arena Telemetry: MBPP Benchmark on DeepSeek Coder 6.7B
This repository hosts the raw evaluation metrics, execution telemetry logs, and structural syntax outputs captured from running the Mostly Basic Python Problems (MBPP) benchmark against the DeepSeek Coder 6.7B parameter model.
This specific run catalogs mid-tier parameter dynamics for legacy code specialists, providing an anchor point to evaluate generational alignment improvements in newer architectures.… See the full description on the dataset page: https://huggingface.co/datasets/ShahzebKhoso/local-code-arena-mbpp-deepseek-coder_6.7b.qwen3-8b_arena-hard-creative-writing
Qwen/Qwen3-8B — arena-hard-creative-writing
Model outputs from the micro-creativity inference suite.
Model: Qwen/Qwen3-8B
Dataset: arena-hard-creative-writing (250 items)
Part of collection: ZachW/llm-creativity-benchmarks
Generation config
temperature: 0.0
max_tokens: 16384
seed: 42
backend: vllm
Columns
Column
Description
task_id
Unique task identifier
input
The exact prompt sent to the model (after meta-prompt application)… See the full description on the dataset page: https://huggingface.co/datasets/ZachW/qwen3-8b_arena-hard-creative-writing.ai-arenaen-conversations
AI Arenaen Conversations
A large dataset of conversations from AI-Arenaen, the Danish subset of the compar:IA platform.
Origin of the data: what is AI-Arenaen?
The conversations are collected using AI-Arenaen, the Danish entry point to the compar:IA platform, which is a Conversational AI comparison tool (a "chatbot arena"), developed within the French Ministry of Culture and adapted for Danish users by Danish Foundation Models and The ministry of digital affair.… See the full description on the dataset page: https://huggingface.co/datasets/danish-foundation-models/ai-arenaen-conversations.qwen3-32b_arena-hard-creative-writing
Qwen/Qwen3-32B — arena-hard-creative-writing
Model outputs from the micro-creativity inference suite.
Model: Qwen/Qwen3-32B
Dataset: arena-hard-creative-writing (250 items)
Part of collection: ZachW/llm-creativity-benchmarks
Generation config
temperature: 0.0
max_tokens: 16384
seed: 42
backend: vllm
Columns
Column
Description
task_id
Unique task identifier
input
The exact prompt sent to the model (after meta-prompt… See the full description on the dataset page: https://huggingface.co/datasets/ZachW/qwen3-32b_arena-hard-creative-writing.