latkes/inside-out-replication-v2-judge-labels

inside-out-replication-v2-judge-labels Judge labels for deduplicated sampled answers. Method is exact_match where the normalized answer equals gold, else a Qwen2.5-14B per-relation CoT judge producing grade A/B/C/D. Dataset Info Rows: 2901127 Columns: 9 Columns Column Type Description question_id Value('string') Question identifier answer Value('string') Deduplicated answer string (full, never truncated) count Value('int64') How… See the full description on the dataset page: https://huggingface.co/datasets/latkes/inside-out-replication-v2-judge-labels.