semeru/code-code-translation-java-csharp

1---2license: mit3Programminglanguage: "Java/C#"4version: "N/A"5Date: "Most likely 2020"6Contaminated: "Very Likely"7Size: "Standard Tokenizer"8---9 10### Dataset is imported from CodeXGLUE and pre-processed using their script.11 12# Where to find in Semeru:13The dataset can be found at /nfs/semeru/semeru_datasets/code_xglue/code-to-code/code-to-code-trans in Semeru14 15 16# CodeXGLUE -- Code2Code Translation17 18## Task Definition19 20Code translation aims to migrate legacy software from one programming language in a platform toanother.21In CodeXGLUE, given a piece of Java (C#) code, the task is to translate the code into C# (Java) version. 22Models are evaluated by BLEU scores, accuracy (exactly match), and [CodeBLEU](https://github.com/microsoft/CodeXGLUE/blob/main/code-to-code-trans/CodeBLEU.MD) scores.23 24## Dataset25 26The dataset is collected from several public repos, including Lucene(http://lucene.apache.org/), POI(http://poi.apache.org/), JGit(https://github.com/eclipse/jgit/) and Antlr(https://github.com/antlr/).27 28We collect both the Java and C# versions of the codes and find the parallel functions. After removing duplicates and functions with the empty body, we split the whole dataset into training, validation and test sets.29 30### Data Format31 32The dataset is in the "data" folder. Each line of the files is a function, and the suffix of the file indicates the programming language.33 34### Data Statistics35 36Data statistics of the dataset are shown in the below table:37 38|       | #Examples |39| ------- | :-------: |40|  Train  |   10,300  |41|  Valid  |      500   |42|   Test  |    1,000  |