model-organisms-for-real/ao-training-task-test-splits
Activation Oracle training-task test splits Held-out classification test splits for the Activation Oracle (AO) training tasks, generated for ten base models that Adam Karvonen released oracles for but never published training data for (hf_push_to_hub=False in his run configs). Each .pt file contains the test split for one (dataset, variant, base model) triple, with precomputed activation vectors — the AO pipeline forces save_acts=True for test splits, so these are ready to… See the full description on the dataset page: https://huggingface.co/datasets/model-organisms-for-real/ao-training-task-test-splits.
0408
classification_ag_news_model_gemma-2-27b-it_n_250_save_acts_False_test_14fdbf7d22d1.ptdownload
classification_ag_news_model_gemma-2-27b-it_n_250_save_acts_False_test_699d424c142d.ptdownload
classification_ag_news_model_gemma-2-9b-it_n_250_save_acts_False_test_5d508f0e8382.ptdownload
classification_ag_news_model_gemma-2-9b-it_n_250_save_acts_False_test_bfe540bec7d6.ptdownload
classification_ag_news_model_gemma-3-27b-it_n_250_save_acts_False_test_3e2844fa4e23.ptdownload
classification_ag_news_model_gemma-3-27b-it_n_250_save_acts_False_test_f39d4b0a3431.ptdownload
classification_ag_news_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_f12cb5616cc9.ptdownload
classification_ag_news_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_f506c69236ee.ptdownload
classification_ag_news_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_4a7910f24109.ptdownload
classification_ag_news_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_a8eb5808c820.ptdownload
classification_ag_news_model_Qwen3-1_7B_n_250_save_acts_False_test_17972a6155b3.ptdownload
classification_ag_news_model_Qwen3-1_7B_n_250_save_acts_False_test_9a16dbff0992.ptdownload
classification_ag_news_model_Qwen3-14B_n_250_save_acts_False_test_31fbade18cf3.ptdownload
classification_ag_news_model_Qwen3-14B_n_250_save_acts_False_test_6635dc2a7739.ptdownload
classification_ag_news_model_Qwen3-32B_n_250_save_acts_False_test_515a6f1520ce.ptdownload
classification_ag_news_model_Qwen3-32B_n_250_save_acts_False_test_67e2279b480c.ptdownload
classification_ag_news_model_Qwen3-4B_n_250_save_acts_False_test_2e772f32e9d4.ptdownload
classification_ag_news_model_Qwen3-4B_n_250_save_acts_False_test_a07edd5ce225.ptdownload
classification_ag_news_model_Qwen3-8B_n_250_save_acts_False_test_777b5113dbc6.ptdownload
classification_ag_news_model_Qwen3-8B_n_250_save_acts_False_test_9425a3cc344d.ptdownload
classification_geometry_of_truth_model_gemma-2-27b-it_n_250_save_acts_False_test_07e6f276a528.ptdownload
classification_geometry_of_truth_model_gemma-2-27b-it_n_250_save_acts_False_test_e1b01f0533d0.ptdownload
classification_geometry_of_truth_model_gemma-2-9b-it_n_250_save_acts_False_test_6eae24c2c4bf.ptdownload
classification_geometry_of_truth_model_gemma-2-9b-it_n_250_save_acts_False_test_86482b486a26.ptdownload
classification_geometry_of_truth_model_gemma-3-27b-it_n_250_save_acts_False_test_de7184e29b86.ptdownload
classification_geometry_of_truth_model_gemma-3-27b-it_n_250_save_acts_False_test_f0ed83c24167.ptdownload
classification_geometry_of_truth_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_dbf51b319cc0.ptdownload
classification_geometry_of_truth_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_e3dc4ef962b9.ptdownload
classification_geometry_of_truth_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_294b7f0caf0f.ptdownload
classification_geometry_of_truth_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_caa53a322af8.ptdownload
classification_geometry_of_truth_model_Qwen3-1_7B_n_250_save_acts_False_test_195b222f0fd4.ptdownload
classification_geometry_of_truth_model_Qwen3-1_7B_n_250_save_acts_False_test_c20b4b5bd904.ptdownload
classification_geometry_of_truth_model_Qwen3-14B_n_250_save_acts_False_test_16cc03c51b75.ptdownload
classification_geometry_of_truth_model_Qwen3-14B_n_250_save_acts_False_test_fc5d16b70db3.ptdownload
classification_geometry_of_truth_model_Qwen3-32B_n_250_save_acts_False_test_157d0f5a4025.ptdownload
classification_geometry_of_truth_model_Qwen3-32B_n_250_save_acts_False_test_4f625e9d9944.ptdownload
classification_geometry_of_truth_model_Qwen3-4B_n_250_save_acts_False_test_bb2a8dbc1805.ptdownload
classification_geometry_of_truth_model_Qwen3-4B_n_250_save_acts_False_test_e94ac94506d3.ptdownload
classification_geometry_of_truth_model_Qwen3-8B_n_250_save_acts_False_test_e3982207cc40.ptdownload
classification_geometry_of_truth_model_Qwen3-8B_n_250_save_acts_False_test_f93c56e3d64d.ptdownload
classification_language_identification_model_gemma-2-27b-it_n_250_save_acts_False_test_10d3590aba6f.ptdownload
classification_language_identification_model_gemma-2-27b-it_n_250_save_acts_False_test_8fa5842feeb6.ptdownload
classification_language_identification_model_gemma-2-9b-it_n_250_save_acts_False_test_2d3a57f3a9e4.ptdownload
classification_language_identification_model_gemma-2-9b-it_n_250_save_acts_False_test_e40c8e8bc726.ptdownload
classification_language_identification_model_gemma-3-27b-it_n_250_save_acts_False_test_00a957cb14b2.ptdownload
classification_language_identification_model_gemma-3-27b-it_n_250_save_acts_False_test_5d1d487b41f5.ptdownload
classification_language_identification_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_2f2093a6e3b5.ptdownload
classification_language_identification_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_b2f7988f4da8.ptdownload
classification_language_identification_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_4f299e3be8e7.ptdownload
classification_language_identification_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_699c88806c1e.ptdownload
classification_language_identification_model_Qwen3-1_7B_n_250_save_acts_False_test_1fb0fc12379e.ptdownload
classification_language_identification_model_Qwen3-1_7B_n_250_save_acts_False_test_ed7d1e4d5664.ptdownload
classification_language_identification_model_Qwen3-14B_n_250_save_acts_False_test_8c084e8c54be.ptdownload
classification_language_identification_model_Qwen3-14B_n_250_save_acts_False_test_d9c5a2d22744.ptdownload
classification_language_identification_model_Qwen3-32B_n_250_save_acts_False_test_0bd93bd26c71.ptdownload
classification_language_identification_model_Qwen3-32B_n_250_save_acts_False_test_c3b52de61a51.ptdownload
classification_language_identification_model_Qwen3-4B_n_250_save_acts_False_test_f7ab1e136bfd.ptdownload
classification_language_identification_model_Qwen3-4B_n_250_save_acts_False_test_fe1e096ecce3.ptdownload
classification_language_identification_model_Qwen3-8B_n_250_save_acts_False_test_7f9e768826e7.ptdownload
classification_language_identification_model_Qwen3-8B_n_250_save_acts_False_test_a995348cf11e.ptdownload
classification_md_gender_model_gemma-2-27b-it_n_250_save_acts_False_test_d90e1ec6ade8.ptdownload
classification_md_gender_model_gemma-2-27b-it_n_250_save_acts_False_test_dccc0ddb89a2.ptdownload
classification_md_gender_model_gemma-2-9b-it_n_250_save_acts_False_test_1731c58de961.ptdownload
classification_md_gender_model_gemma-2-9b-it_n_250_save_acts_False_test_8489e72e9331.ptdownload
classification_md_gender_model_gemma-3-27b-it_n_250_save_acts_False_test_63eec181faa5.ptdownload
classification_md_gender_model_gemma-3-27b-it_n_250_save_acts_False_test_7d2998ba703a.ptdownload
classification_md_gender_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_367815e25770.ptdownload
classification_md_gender_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_47a01bb95c7c.ptdownload
classification_md_gender_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_81bfd934846d.ptdownload
classification_md_gender_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_bb09a15e6aac.ptdownload
classification_md_gender_model_Qwen3-1_7B_n_250_save_acts_False_test_675cb97992bd.ptdownload
classification_md_gender_model_Qwen3-1_7B_n_250_save_acts_False_test_907a48286004.ptdownload
classification_md_gender_model_Qwen3-14B_n_250_save_acts_False_test_1cc04db3eb61.ptdownload
classification_md_gender_model_Qwen3-14B_n_250_save_acts_False_test_6e9f41be12cb.ptdownload
classification_md_gender_model_Qwen3-32B_n_250_save_acts_False_test_4557b0683e10.ptdownload
classification_md_gender_model_Qwen3-32B_n_250_save_acts_False_test_66cc6c5a6369.ptdownload
classification_md_gender_model_Qwen3-4B_n_250_save_acts_False_test_39d9bf461de4.ptdownload
classification_md_gender_model_Qwen3-4B_n_250_save_acts_False_test_40010d709767.ptdownload
classification_md_gender_model_Qwen3-8B_n_250_save_acts_False_test_2d54e9de5c79.ptdownload
classification_md_gender_model_Qwen3-8B_n_250_save_acts_False_test_e6c6807146d2.ptdownload
classification_ner_model_gemma-2-27b-it_n_250_save_acts_False_test_a82463afbf2a.ptdownload
classification_ner_model_gemma-2-27b-it_n_250_save_acts_False_test_aaff4532f87e.ptdownload
classification_ner_model_gemma-2-9b-it_n_250_save_acts_False_test_06627017574a.ptdownload
classification_ner_model_gemma-2-9b-it_n_250_save_acts_False_test_654bd50c0077.ptdownload
classification_ner_model_gemma-3-27b-it_n_250_save_acts_False_test_27ce77eacfce.ptdownload
classification_ner_model_gemma-3-27b-it_n_250_save_acts_False_test_c34456f8c043.ptdownload
classification_ner_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_541157390ee7.ptdownload
classification_ner_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_c3dfff07f9bb.ptdownload
classification_ner_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_1d7f23099311.ptdownload
classification_ner_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_402662d3bc13.ptdownload
classification_ner_model_Qwen3-1_7B_n_250_save_acts_False_test_8a1e3016695e.ptdownload
classification_ner_model_Qwen3-1_7B_n_250_save_acts_False_test_bcff623a1b44.ptdownload
classification_ner_model_Qwen3-14B_n_250_save_acts_False_test_6875e197fb98.ptdownload
classification_ner_model_Qwen3-14B_n_250_save_acts_False_test_d0fb0e608db5.ptdownload
classification_ner_model_Qwen3-32B_n_250_save_acts_False_test_85ae8b27f38a.ptdownload
classification_ner_model_Qwen3-32B_n_250_save_acts_False_test_c1eb6302d534.ptdownload
classification_ner_model_Qwen3-4B_n_250_save_acts_False_test_0433f81c4ebb.ptdownload
classification_ner_model_Qwen3-4B_n_250_save_acts_False_test_107186d0cef7.ptdownload
classification_ner_model_Qwen3-8B_n_250_save_acts_False_test_19421ed22fd8.ptdownload
classification_ner_model_Qwen3-8B_n_250_save_acts_False_test_c0c3844cba16.ptdownload
classification_relations_model_gemma-2-27b-it_n_250_save_acts_False_test_644395dac8b0.ptdownload
classification_relations_model_gemma-2-27b-it_n_250_save_acts_False_test_cce047a35ad4.ptdownload
classification_relations_model_gemma-2-9b-it_n_250_save_acts_False_test_6290660ece48.ptdownload
classification_relations_model_gemma-2-9b-it_n_250_save_acts_False_test_6366059211b4.ptdownload
classification_relations_model_gemma-3-27b-it_n_250_save_acts_False_test_185163712ad8.ptdownload
classification_relations_model_gemma-3-27b-it_n_250_save_acts_False_test_a757dcbbda43.ptdownload
classification_relations_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_294f9164687d.ptdownload
classification_relations_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_d97cebaccf53.ptdownload
classification_relations_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_28c2cc801958.ptdownload
classification_relations_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_71e1c10a3fa5.ptdownload
classification_relations_model_Qwen3-1_7B_n_250_save_acts_False_test_c1f72f8f73d3.ptdownload
classification_relations_model_Qwen3-1_7B_n_250_save_acts_False_test_fb9885ff0b46.ptdownload
classification_relations_model_Qwen3-14B_n_250_save_acts_False_test_3be76aae834b.ptdownload
classification_relations_model_Qwen3-14B_n_250_save_acts_False_test_659d6d9fe4d1.ptdownload
classification_relations_model_Qwen3-32B_n_250_save_acts_False_test_75fbc9ed3579.ptdownload
classification_relations_model_Qwen3-32B_n_250_save_acts_False_test_7d33de5834b3.ptdownload
classification_relations_model_Qwen3-4B_n_250_save_acts_False_test_890ccd724a8f.ptdownload
classification_relations_model_Qwen3-4B_n_250_save_acts_False_test_b796690cb19a.ptdownload
classification_relations_model_Qwen3-8B_n_250_save_acts_False_test_0ba807d3f2ca.ptdownload
classification_relations_model_Qwen3-8B_n_250_save_acts_False_test_85f4e60531b0.ptdownload
classification_singular_plural_model_gemma-2-27b-it_n_250_save_acts_False_test_2880f91af09a.ptdownload
classification_singular_plural_model_gemma-2-27b-it_n_250_save_acts_False_test_f1552d626f04.ptdownload
classification_singular_plural_model_gemma-2-9b-it_n_250_save_acts_False_test_8f75d0b2f284.ptdownload
classification_singular_plural_model_gemma-2-9b-it_n_250_save_acts_False_test_b04f3db47f83.ptdownload
classification_singular_plural_model_gemma-3-27b-it_n_250_save_acts_False_test_8a5eeb2ad346.ptdownload
classification_singular_plural_model_gemma-3-27b-it_n_250_save_acts_False_test_b872dbaa9ccc.ptdownload
classification_singular_plural_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_0151e8a8cef3.ptdownload
classification_singular_plural_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_b3b4668e9f99.ptdownload
classification_singular_plural_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_37b1be2a1fc5.ptdownload
classification_singular_plural_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_93043d466fe0.ptdownload
classification_singular_plural_model_Qwen3-1_7B_n_250_save_acts_False_test_4873dabceedc.ptdownload
classification_singular_plural_model_Qwen3-1_7B_n_250_save_acts_False_test_6ae08ff332f5.ptdownload
classification_singular_plural_model_Qwen3-14B_n_250_save_acts_False_test_3a1dfc140294.ptdownload
classification_singular_plural_model_Qwen3-14B_n_250_save_acts_False_test_ffdd46898f44.ptdownload
classification_singular_plural_model_Qwen3-32B_n_250_save_acts_False_test_12ab20c622fb.ptdownload
classification_singular_plural_model_Qwen3-32B_n_250_save_acts_False_test_d10518d9e787.ptdownload
classification_singular_plural_model_Qwen3-4B_n_250_save_acts_False_test_4b1b61646612.ptdownload
classification_singular_plural_model_Qwen3-4B_n_250_save_acts_False_test_9380265bacc9.ptdownload
classification_singular_plural_model_Qwen3-8B_n_250_save_acts_False_test_4e3b9697ecdd.ptdownload
classification_singular_plural_model_Qwen3-8B_n_250_save_acts_False_test_ea6572ea2ab6.ptdownload
classification_snli_model_gemma-2-27b-it_n_250_save_acts_False_test_3a1d0659a66a.ptdownload
classification_snli_model_gemma-2-27b-it_n_250_save_acts_False_test_ebdc858efa0a.ptdownload
classification_snli_model_gemma-2-9b-it_n_250_save_acts_False_test_a0f860f31603.ptdownload
classification_snli_model_gemma-2-9b-it_n_250_save_acts_False_test_a8bdd0baff6b.ptdownload
classification_snli_model_gemma-3-27b-it_n_250_save_acts_False_test_b93197a9beda.ptdownload
classification_snli_model_gemma-3-27b-it_n_250_save_acts_False_test_cc6caaf63c66.ptdownload
classification_snli_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_98ec154018e6.ptdownload
classification_snli_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_f56e1c52dccb.ptdownload
classification_snli_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_2c13726a5cd4.ptdownload
classification_snli_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_ce69736d430c.ptdownload
classification_snli_model_Qwen3-1_7B_n_250_save_acts_False_test_3c160084d9f2.ptdownload
classification_snli_model_Qwen3-1_7B_n_250_save_acts_False_test_75ca651f83d7.ptdownload
classification_snli_model_Qwen3-14B_n_250_save_acts_False_test_2bf1af3dce3a.ptdownload
classification_snli_model_Qwen3-14B_n_250_save_acts_False_test_e4f12c72f5fe.ptdownload
classification_snli_model_Qwen3-32B_n_250_save_acts_False_test_0573ed78a030.ptdownload
classification_snli_model_Qwen3-32B_n_250_save_acts_False_test_91e6e2c7785d.ptdownload
classification_snli_model_Qwen3-4B_n_250_save_acts_False_test_0329afe7d6c5.ptdownload
classification_snli_model_Qwen3-4B_n_250_save_acts_False_test_fc5ab5cae371.ptdownload
classification_snli_model_Qwen3-8B_n_250_save_acts_False_test_562147b02df6.ptdownload
classification_snli_model_Qwen3-8B_n_250_save_acts_False_test_842b358f4843.ptdownload
classification_sst2_model_gemma-2-27b-it_n_250_save_acts_False_test_3ce9caee909e.ptdownload
classification_sst2_model_gemma-2-27b-it_n_250_save_acts_False_test_64cdaae23f6e.ptdownload
classification_sst2_model_gemma-2-9b-it_n_250_save_acts_False_test_4bcb77f8a54f.ptdownload
classification_sst2_model_gemma-2-9b-it_n_250_save_acts_False_test_6a0c50384a7d.ptdownload
classification_sst2_model_gemma-3-27b-it_n_250_save_acts_False_test_0a1469f2aab5.ptdownload
classification_sst2_model_gemma-3-27b-it_n_250_save_acts_False_test_2e81e52f1129.ptdownload
classification_sst2_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_80e7c918c558.ptdownload
classification_sst2_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_e9353f01d879.ptdownload
classification_sst2_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_471d3edd0e1d.ptdownload
classification_sst2_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_c582f0bc00b7.ptdownload
classification_sst2_model_Qwen3-1_7B_n_250_save_acts_False_test_72c99795174d.ptdownload
classification_sst2_model_Qwen3-1_7B_n_250_save_acts_False_test_85af526b5026.ptdownload
classification_sst2_model_Qwen3-14B_n_250_save_acts_False_test_3c228f475446.ptdownload
classification_sst2_model_Qwen3-14B_n_250_save_acts_False_test_9eb699c487c1.ptdownload
classification_sst2_model_Qwen3-32B_n_250_save_acts_False_test_8678b4432deb.ptdownload
classification_sst2_model_Qwen3-32B_n_250_save_acts_False_test_a3a56f28d938.ptdownload
classification_sst2_model_Qwen3-4B_n_250_save_acts_False_test_2a6d8a36f2e2.ptdownload
classification_sst2_model_Qwen3-4B_n_250_save_acts_False_test_ea6b6d103979.ptdownload
classification_sst2_model_Qwen3-8B_n_250_save_acts_False_test_284c90fa1cfc.ptdownload
classification_sst2_model_Qwen3-8B_n_250_save_acts_False_test_dd78147ea7d7.ptdownload
classification_tense_model_gemma-2-27b-it_n_250_save_acts_False_test_3143486193ed.ptdownload
classification_tense_model_gemma-2-27b-it_n_250_save_acts_False_test_386ee34f9299.ptdownload
classification_tense_model_gemma-2-9b-it_n_250_save_acts_False_test_054758ff03e6.ptdownload
classification_tense_model_gemma-2-9b-it_n_250_save_acts_False_test_d03cb473eb38.ptdownload
classification_tense_model_gemma-3-27b-it_n_250_save_acts_False_test_3c9e32bdfbfd.ptdownload
classification_tense_model_gemma-3-27b-it_n_250_save_acts_False_test_b224ae7ab8ac.ptdownload
classification_tense_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_8777412f84b6.ptdownload
classification_tense_model_Llama-3_1-8B-Instruct_n_250_save_acts_False_test_cee6147fd2eb.ptdownload
classification_tense_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_81fa2b5c1ca3.ptdownload
classification_tense_model_Llama-3_2-1B-Instruct_n_250_save_acts_False_test_f0adb84cf8e5.ptdownload
classification_tense_model_Qwen3-1_7B_n_250_save_acts_False_test_1ede004b7cac.ptdownload
classification_tense_model_Qwen3-1_7B_n_250_save_acts_False_test_bc8964e5b085.ptdownload
classification_tense_model_Qwen3-14B_n_250_save_acts_False_test_aca1433c2e84.ptdownload
classification_tense_model_Qwen3-14B_n_250_save_acts_False_test_f935939b286e.ptdownload
classification_tense_model_Qwen3-32B_n_250_save_acts_False_test_7511a5424830.ptdownload
classification_tense_model_Qwen3-32B_n_250_save_acts_False_test_a22473d83c82.ptdownload
classification_tense_model_Qwen3-4B_n_250_save_acts_False_test_047ebed40f03.ptdownload
classification_tense_model_Qwen3-4B_n_250_save_acts_False_test_125099489e58.ptdownload
classification_tense_model_Qwen3-8B_n_250_save_acts_False_test_2df982b24165.ptdownload
classification_tense_model_Qwen3-8B_n_250_save_acts_False_test_bb2a98142e7d.ptdownload
