Cross-Mergeability/crossarch-accuracy

crossarch-accuracy — downstream accuracy for the ~1B merge results Companion to Mergeability-2/crossarch-1b-diagnostics, which measured 106 Pythia-1.4B / Zh-Pythia-1.4B checkpoint-merge pairs, 1 native cross-model merge and 20 transport merges entirely in nats/token. This repo adds the accuracy axis: does any of it produce a usable model? Headline question (Figure 1). The diagnostics found that checkpoint pairs within about half a decade of training are linearly mode-connected… See the full description on the dataset page: https://huggingface.co/datasets/Cross-Mergeability/crossarch-accuracy.