datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Jam-CGPT
Jam-CGPT
Jam-CGPT dataset contains the summary generated by using GPT-3.5. The dataset size ranges from 170k to 2.15m. We follow Jam's procedure to compile the dataset for finetuning.
Jam-CGPT dataset files
Filename
Description
170k.tar.gz
170k summary train and val bin file
620k.tar.gz
620k summary train and val bin file
1.25m.tar.gz
1.25m summary train and val bin file
2.15m.tar.gz
2.15m summary train and val bin file
jam_cgpt_test.tar.gz
Jam-CGPT… See the full description on the dataset page: https://huggingface.co/datasets/apcl/Jam-CGPT.funcom-java-long
funcom-java-long
funcom-java-long is a dataset for code summarization presented by Bansal et al. It includes 170k Java methods and summaries for training and 8,192 Java methods in test set. This dataset is extracted from jm52m and is cleaned and deduplicated. The example prompt for fine-tuning is as follows.
TDAT: <method code> COMMENT: <comment> <!endofdoc>
funcom_test.tar.gz -- a compressed directory for test set with the text inside this folder whose filename =… See the full description on the dataset page: https://huggingface.co/datasets/apcl/funcom-java-long.jam_contextsum
Jam-Contextsum
Jam-Contextsum dataset contains the method, the summary that explains why the method exists, caller of the method, and the summary of the call graph method generated by using jam-cgpt.
Jam-Contextsum dataset files
Filename
Description
contextsum.pkl
methods with the summary that explains why the method exists, caller of the method, and the summary of the caller generated by using jam-cgpt
unique_methods.pkl
all of the unique methods
Note… See the full description on the dataset page: https://huggingface.co/datasets/apcl/jam_contextsum.