repro
Datasets
All datasets matching “repro”repro-scriptsverdicts
Logbook verdicts
Per-logbook claim verdicts produced by the logbook-judge Space. See verdicts.json.
REPRO-Bench
REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research?
This repository contains the REPRO-Bench dataset, introduced in the paper REPRO-Bench: Can Agentic AI Systems Assess the Reproducibility of Social Science Research?.
REPRO-Bench is a novel benchmark designed to evaluate the capability of agentic AI systems in automating the assessment of social science paper reproducibility. It addresses limitations of existing benchmarks by providing a… See the full description on the dataset page: https://huggingface.co/datasets/chuxuan/REPRO-Bench.challenge
The ICML 2026 reproduction challenge ended on August 2, 2026 (23:59 AoE).
New or updated logbooks are no longer judged and prize consideration is closed.
The instructions below remain for reference; published logbooks stay online.
Reproducing ICML 2026 — Challenge Guide (for agents)
You are a coding agent contributing to a community effort organized by Hugging Face and AlphaXiv to reproduce the major claims of every ICML 2026 paper.
Task
Your task is to… See the full description on the dataset page: https://huggingface.co/datasets/ICML-2026-agent-repro/challenge.InternUtopia-repro-assets
RoboAssemblyBench
RoboAssemblyBench is a reproduction branch of InternUtopia focused on atomic-skill based robotic assembly. The current checkpoint contains a dual-UR5e + Robotiq 2F-85 Fabrica plumbers-block task:
fabrica_plumbers_block_ur5e_right_base_prepare
The task stages part 2 with the right arm, then uses the left arm to place part 0 into the staged part-2 slot, stack part 3, and insert parts 4 and 1 into the remaining holes.
Quick Preview
Example rollout… See the full description on the dataset page: https://huggingface.co/datasets/baiyu858/InternUtopia-repro-assets.flashvsr-repro-outputs-v2-part1
FlashVSR 复现实验输出 — part1
FlashVSR 复现及 KV cache 驱逐策略消融实验的逐帧推理输出，以 FFV1 无损编码归档。
本 repo 是全部结果的第 1/2 部分。
内容
reds_bscv_dbl_clean_full_sliding
reds_bscv_dbl_clean_full_sliding_kv10
reds_bscv_dbl_clean_full_sliding_kv6
reds_bscv_dbl_full_gate
reds_bscv_dbl_full_gate_kv10
reds_bscv_dbl_full_gate_kv6
reds_bscv_dbl_full_gate_lfres
reds_bscv_dbl_full_gate_lfres_frame
reds_bscv_dbl_full_gate_lfres_frame_kv10
reds_bscv_dbl_full_gate_lfres_frame_kv6… See the full description on the dataset page: https://huggingface.co/datasets/victorzhu30/flashvsr-repro-outputs-v2-part1.