anivenu/gaia-verified

GAIA-Verified A corrected subset of GAIA's validation split: 147 of the original 165 tasks. 27 of GAIA's 165 validation tasks (16.4%) are defective. 18 could not be salvaged and were removed; 9 had a gold answer that is simply wrong and were corrected. Questions were never rewritten and the scorer was never patched. Defective 27 / 165 (16.4%) Removed 18 Golds corrected 9 GAIA-Verified 147 tasks Every verdict, with its evidence, is in the audit:… See the full description on the dataset page: https://huggingface.co/datasets/anivenu/gaia-verified.