RealTimeData/code_alltime
RealTimeData Monthly Collection - Github Code This datasets provides the monthly screenshots of the 500 cherry-picked open source projects on GitHub from 2017 to current. To access articles in a specific month, simple run the following: ds = datasets.load_dataset('RealTimeData/code_alltime', '2020-02') This will give you the 2020-02 version of the 500 selected GitHub repos that were just updated in 2020-02. Want to crawl the data by your own? Please head to… See the full description on the dataset page: https://huggingface.co/datasets/RealTimeData/code_alltime.
RealTimeData Monthly Collection - Github Code
This datasets provides the monthly screenshots of the 500 cherry-picked open source projects on GitHub from 2017 to current.
To access articles in a specific month, simple run the following:
ds = datasets.load_dataset('RealTimeData/code_alltime', '2020-02')This will give you the 2020-02 version of the 500 selected GitHub repos that were just updated in 2020-02.
Want to crawl the data by your own?
Please head to LatestEval for the crawler scripts.
Credit
This is resources is created in this AAAI'24 paper: LatestEval: Addressing data contamination through dynamic and time-sensitive test construction.
If you find this collection helpful, please consider cite this paper:
@inproceedings{li2024latesteval,
title={Latesteval: Addressing data contamination in language model evaluation through dynamic and time-sensitive test construction},
author={Li, Yucheng and Guerin, Frank and Lin, Chenghua},
booktitle={Proceedings of the AAAI Conference on Artificial Intelligence},
volume={38},
number={17},
pages={18600--18607},
year={2024}
}