datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
source_code纯文本数据，内容：高质量编程源代码，包括Python，Java，CPP源代码python-algorithm-sourcecode
Dataset Card for Dataset Name
This dataset card aims to be a base template for new datasets. It has been generated using this raw template.
Dataset Details
Dataset Description
This dataset provides algorithms and corresponding Python source code which can be leveraged for any type of code conversion applications.
Curated by: [More Information Needed]
Funded by [optional]: [More Information Needed]
Shared by [optional]: [More Information Needed]… See the full description on the dataset page: https://huggingface.co/datasets/annawleo/python-algorithm-sourcecode.sourcecode-detectionsource-code-Review-vulnSourceCodeLiteCoder_SourceCode
LiteCoder Experiment Reproducing package
To run the pre-train objective use the following scripts:
Reproduce LiteCoder with all objectives:
Navigate the folder Pre-training containing the LiteCoder.py file
Then, run Python LiteCoder.py --train-tt --train-cs --train-pd
The pretrained model is released on hugging face, therefore it automatically loads.
To run the ablation studies:
Ablation 1: Python LiteCoder.py --train-tt
Ablation 2: Python LiteCoder.py --train-tt… See the full description on the dataset page: https://huggingface.co/datasets/LiteCoder/LiteCoder_SourceCode.hollow-knight-silk-song-sourcecode