CoolFace
Datasetpublic

lmarena-ai/leaderboard-dataset

Arena Leaderboard Dataset Historical snapshots of the Arena leaderboard. Usage from datasets import load_dataset # Load all historical text style control data ds = load_dataset("lmarena-ai/leaderboard-dataset", "text_style_control", split="full") # Load the current text style control leaderboard ds = load_dataset("lmarena-ai/leaderboard-dataset", "text_style_control", split="latest") # Filter to overall category ds =… See the full description on the dataset page: https://huggingface.co/datasets/lmarena-ai/leaderboard-dataset.

sourceHugging Facecc-by-4.0updated 10h agoView on Hugging Face
25likes44kdownloads
Dataset Card

Arena Leaderboard Dataset

Historical snapshots of the Arena leaderboard.

Usage

python
from datasets import load_dataset

# Load all historical text style control data
ds = load_dataset("lmarena-ai/leaderboard-dataset", "text_style_control", split="full")

# Load the current text style control leaderboard
ds = load_dataset("lmarena-ai/leaderboard-dataset", "text_style_control", split="latest")

# Filter to overall category
ds = load_dataset("lmarena-ai/leaderboard-dataset", "text_style_control", split="latest",
    filters=[("category", "==", "overall")]
)

# Track a specific model's rating over time
ds = load_dataset("lmarena-ai/leaderboard-dataset", "text_style_control", split="full",
    filters=[("category", "==", "overall"), ("model_name", "==", "gpt-4o-2024-05-13")],
    columns=["model_name", "rating", "rank", "leaderboard_publish_date"]
)

# Load raw (non-style-controlled) text ratings
ds = load_dataset("lmarena-ai/leaderboard-dataset", "text", split="full")

# Load the current Agent Arena leaderboard
ds = load_dataset("lmarena-ai/leaderboard-dataset", "agent", split="latest")

Subsets

Each arena is a separate subset, arenas with style control have an additional subset with a _style_control suffix .

  • text, text_style_control
  • vision, vision_style_control
  • search, search_style_control
  • document, document_style_control
  • webdev (Code Arena)
  • text_to_image
  • image_edit
  • text_to_video
  • image_to_video
  • video_edit
  • agent (Agent Arena aggregate), plus per-signal subsets: agent_bash_recovery_steps, agent_praise_complaint, agent_steerability, agent_task_outcome_explicit, agent_tool_hallucination

Splits

  • full: All historically published leaderboards
  • latest: Only the most recently published leaderboards

Notes

  • On January 9, 2024, the rating system was updated from Elo to Bradley-Terry.
  • On May 16, 2025, style control was made the default for text and vision arenas and the offset was adjusted to put the style control leaderboard on the same rating scale as non style control.
  • On July 23, 2025, frequency-based re-weighting was implemented.
  • Search and Webdev Arena data starts from their releases on the arena.ai (then lmarena.ai) on August 7 and November 12 2025 respectively.
  • Agent Arena data starts from its release on June 4, 2026.

For a complete record of all leaderboard methodology changes, see the Leaderboard Changelog.

Schema

ColumnTypeDescription
model_namestringModel identifier
organizationstringModel creator/organization
licensestringModel license
ratingfloatArena Score
rating_lowerfloatLower confidence bound
rating_upperfloatUpper confidence bound
variancefloatRating variance
vote_countintNumber of battles for this model
rankintRank within this leaderboard
categorystringLeaderboard category (e.g., overall, coding, math)
leaderboardpublishdatestringDate that this score was published (YYYY-MM-DD)

Agent Arena subsets use IPS scores instead of Bradley-Terry:

ColumnTypeDescription
model_namestringModel identifier
organizationstringModel creator/organization
licensestringModel license
scorefloatIPS score (τ̂)
scorecilowerfloatLower 95% confidence bound
scoreciupperfloatUpper 95% confidence bound
observation_countintSignal observations for this model
session_countintDistinct sessions (aggregate subset only)
rankintRank within this leaderboard
categorystringLeaderboard category
leaderboardpublishdatestringDate that this score was published (YYYY-MM-DD)