latkes/factprobe-replication-stagematched-7b-v1

Stage-matched probing of OLMo-2-7B (49,218,520 rows) Five training stages (S1 end of pretraining, S2 released base, S3 SFT, S4 DPO, S5 Instruct) x four Wikidata relations (P26 spouse, P3373 sibling, P190 twinnedTown, P47 bordersWith) x two phrasings (question, statement), each run with 1:1 scrambled negatives drawn with a fixed seed so the negative set is identical at every stage. Few-shot prompt held fixed across all stages; only the model weights differ. column meaning… See the full description on the dataset page: https://huggingface.co/datasets/latkes/factprobe-replication-stagematched-7b-v1.