latkes/factprobe-replication-arm-a-olmo2-32b-instruct-v1

factprobe-replication-arm-a-olmo2-32b-instruct-v1 Arm (a) sanity replication of He et al. arXiv:2503.22362: their code, their Zenodo triples, their prompts (chat template, 36 alias variations, greedy). One row per (pair, direction, alias-variation) with the full generated text. Bucketing/analysis is done downstream (their analyse_experiment.py); OLMo cells reproduce their Tables 2/4 to +/-0.006. Dataset Info Rows: 5175168 Columns: 10 Columns… See the full description on the dataset page: https://huggingface.co/datasets/latkes/factprobe-replication-arm-a-olmo2-32b-instruct-v1.