starmage520/Coderbert_finetuned_detect_vulnerability_on_MSR

I finetuned a RobertaForSequenceClassification model which is initialized from CodeBert [https://huggingface.co/microsoft/codebert-base] to judge whether a code is vulnerable or not. I selected balanced samples from MSR dataset [https://github.com/ZeoVan/MSR20CodevulnerabilityCSVDataset] for training, validation, and testing. The "funcbefore" is used for code classification. All the data is in the file "msr.csv".

Test Reulsts: acc 0.7022935779816514, f1 0.6482384823848238, precision 0.7920529801324503, recall 0.5486238532110091