contamination
mmlu_olmo_contaminationtoaa_benchmark_contaminationmmlu_olmo3_contaminationContaminationQAfinemath_contamination_report
🧹
This dataset contains suspected benchmark-contaminated pages that were removed from the FineMath dataset.
GameBoyWorlds-Playthrough-Contamination-Check
Documentation Density Predicts Benchmark Performance: A Contamination Probe Using Official and Fan-Made Pokémon Titles
Abstract. Benchmark scores on well-documented domains conflate what a model can reason about with what it has memorised. We construct a 400-item short-answer benchmark over four Game Boy–era Pokémon titles, paired by surface form but differing sharply in corpus footprint: two officially published games (Red, Crystal) and two community ROM hacks (Brown, Prism).… See the full description on the dataset page: https://huggingface.co/datasets/DJ-Research/GameBoyWorlds-Playthrough-Contamination-Check.