datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
livecodebench-merging-leaderboard
LiveCodeBench v6 Evaluation Leaderboard
Evaluation results for cross-capability merging of OLMo-3 and OLMo-3.1 RL-Zero models on 454 coding problems.
Evaluation
We followed the evaluation guidelines and prompts from OLMo 3. Best effort was made to ensure reported numbers are as accurate as possible.
Code: pmahdavi/modal-eval
Leaderboard
Model
pass@4
pass@1
Loop Rate
Qwen/Qwen3-4B-Thinking-2507
54.6%
45.4%
0.4%
pmahdavi/Olmo-3-7B-Think-Math-Code… See the full description on the dataset page: https://huggingface.co/datasets/pmahdavi/livecodebench-merging-leaderboard.livecodebench
LiveCodeBench for Code-LLaVA
This dataset contains the LiveCodeBench code generation benchmark prepared for
Code-LLaVA evaluation.
Source
Paper: LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Code
Repository: https://github.com/LiveCodeBench/LiveCodeBench
Version: release_v6 (May 2023 - Apr 2025, 1055 problems)
Dataset Structure
Two configurations are available:
memwrap: Problems with <|memory_start|> /… See the full description on the dataset page: https://huggingface.co/datasets/tonychenxyz/livecodebench.LiveCodeBench-v6-R182
LiveCodeBench-v6-R182
The 182 problems obtained by taking the release_v6 slice of livecodebench/code_generation_lite and keeping only those with contest_date >= 2025-01-01 (contest dates span 2025-01-04 to 2025-04-06).
Usage
from datasets import load_dataset
ds = load_dataset("jwu323/LiveCodeBench-v6-R182", split="test")
print(ds[0]["question_title"], ds[0]["contest_date"])