augustinian-babylm/vpswap-checkpoint-scores

VP-Swap checkpoint scores Per-item correctness on the VP-Swap benchmark for nine models at twenty points in training. This is the raw material behind Figures 4-6 of Augustinian BabyLM (paper, code). Layout <model>/<revision>.jsonl, one line per benchmark item: {"property": "color", "line": 6, "which": 1, "pll_orig": -21.4213, "pll_swap": -23.9077, "correct": true} property and line identify the source line in eval/vpswap_bb24/vp_swap_<property>_pairs.txt; which… See the full description on the dataset page: https://huggingface.co/datasets/augustinian-babylm/vpswap-checkpoint-scores.