Cross-Mergeability/crossarch-1b-diagnostics

Cross-architecture mergeability diagnostics for five ~1B monolingual LMs A third model family for the mergeability project, alongside Goldfish and Beetle/MergeBench. Read this first: what "merging" means for these five models Five independently trained ~1B monolingual models were requested: Pythia-1.4B (EN), Zh-Pythia-1.4B (ZH), Tucano-1b1 (PT), Bielik-1.5B-v3 (PL), Minerva-1B (IT). They differ in architecture family, hidden dimension (1536 vs 2048), depth (16 /… See the full description on the dataset page: https://huggingface.co/datasets/Cross-Mergeability/crossarch-1b-diagnostics.