tummitum/Data-Collection
Deprecated-API Code Generation Benchmark Python functions mined from open-source repositories, each anchored on a library API that has since been deprecated or replaced. Used to test whether a code LLM still emits the outdated API, and to build forget / test splits per model. Structure outdated_all.json # O — samples calling the deprecated API uptodated_all.json # U — samples calling the replacement API <model>/ # codegen |… See the full description on the dataset page: https://huggingface.co/datasets/tummitum/Data-Collection.
Deprecated-API Code Generation Benchmark
Python functions mined from open-source repositories, each anchored on a library API that has since been deprecated or replaced. Used to test whether a code LLM still emits the outdated API, and to build forget / test splits per model.
Structure
outdated_all.json # O — samples calling the deprecated API
uptodated_all.json # U — samples calling the replacement API
<model>/ # codegen | codellama | deepseek | starcoder
├── updated_dep.json # samples of U where this model still emits the OLD API
├── D_forget.json # O + half of updated_dep
├── D_test.json # U minus that same half
├── D_test_U_dep.json # part of D_test that is in updated_dep
└── D_test_U_nondep.json # the rest of D_testO and U are disjoint. updated_dep.json is model-specific and is a subset of U: half of it goes into D_forget, the other half stays in D_test and is exactly D_test_U_dep. So D_forget ∩ D_test = ∅ and D_test_U_dep + D_test_U_nondep = D_test.