AmazonScience/migration-bench-java-utg

MigrationBench

<table> <tr> <td style="padding: 0;"> <a href="https://huggingface.co/collections/AmazonScience/migrationbench-68125452fc21a4564b92b6c3"> <img src="https://img.shields.io/badge/-🤗 MigrationBench-4d5eff?style=flatten&labelColor" alt="MigrationBench (Hugging Face)"> </a> </td> <td style="padding: 0;"> <a href="https://github.com/amazon-science/MigrationBench"> <img src="https://img.shields.io/badge/MigrationBench-000000?style=flatten&logo=github" alt="MigrationBench (GitHub)"> </a> </td> <td style="padding: 0;"> <a href="https://github.com/amazon-science/SDFeedback"> <img src="https://img.shields.io/badge/SDFeedback-000000?style=flatten&logo=github&logoColor=white" alt="SDFeedback (GitHub)"> </a> </td> <td style="padding: 0;"> <a href="https://arxiv.org/abs/2505.09569"> <img src="https://img.shields.io/badge/arXiv-2505.09569-b31b1b.svg?style=flatten" alt="MigrationBench (arXiv)"> </a> </td> <td style="padding: 0; padding-left: 10px; vertical-align: middle;"> <a href="https://huggingface.co/datasets/AmazonScience/migration-bench-java-full"> <img src="https://img.shields.io/badge/-🤗 java--full-8a98ff?style=flat&labelColor" alt="java-full"> </a> </td> <td style="padding: 0; vertical-align: middle;"> <a href="https://huggingface.co/datasets/AmazonScience/migration-bench-java-selected"> <img src="https://img.shields.io/badge/-🤗 java--selected-8a98ff?style=flat&labelColor" alt="java-selected"> </a> </td> <td style="padding: 0; vertical-align: middle;"> <a href="https://huggingface.co/datasets/AmazonScience/migration-bench-java-utg"> <img src="https://img.shields.io/badge/-🤗 java--utg-8a98ff?style=flat&labelColor" alt="java-utg"> </a> </td> </tr> </table>

1. 📖 Overview

🤗 MigrationBench is a large-scale code migration benchmark dataset at the repository level, across multiple programming languages.

• —Current and initial release includes java 8 repositories with the maven build system, as of May 2025.

2. Datasets

There are three datasets in 🤗 MigrationBench:

• —All repositories included in the datasets are available on GitHub, under the MIT or Apache-2.0 license.

3. Metadata

Metadata is provided in the csv file for each dataset:

1. 1.repo (str): The original repo URL without the https://github.com/ prefix
2. 2.base_commit (str): Base commit id
3. 3.At this commit with java 8 and maven, the repository is able to (1) compile and (2) pass existing unit tests and integration tests if any
4. 4.It is the starting point for code migration from java 8
5. 5.license (str): The license of the repository, either MIT or Apache2.0 for the whole dataset

4. 📚 Citation

@misc{liu2025migrationbenchrepositorylevelcodemigration,
      title={MigrationBench: Repository-Level Code Migration Benchmark from Java 8},
      author={Linbo Liu and Xinle Liu and Qiang Zhou and Lin Chen and Yihan Liu and Hoan Nguyen and Behrooz Omidvar-Tehrani and Xi Shen and Jun Huan and Omer Tripp and Anoop Deoras},
      year={2025},
      eprint={2505.09569},
      archivePrefix={arXiv},
      primaryClass={cs.SE},
      url={https://arxiv.org/abs/2505.09569},
}