RealTimeData/arxiv_alltime
RealTimeData Monthly Collection - ArXiv This datasets contains selected papers from arXiv that were created every months from 2017 to current. To access papers in a specific month, simple run the following: ds = datasets.load_dataset('RealTimeData/arxiv_alltime', '2020-02') This will give you about 1k selected papers that were created in 2020-02. Want to crawl the data by your own? Please head to LatestEval for the crawler scripts. Credit This is… See the full description on the dataset page: https://huggingface.co/datasets/RealTimeData/arxiv_alltime.
RealTimeData Monthly Collection - ArXiv
This datasets contains selected papers from arXiv that were created every months from 2017 to current.
To access papers in a specific month, simple run the following:
ds = datasets.load_dataset('RealTimeData/arxiv_alltime', '2020-02')This will give you about 1k selected papers that were created in 2020-02.
Want to crawl the data by your own?
Please head to LatestEval for the crawler scripts.
Credit
This is resources is created in this AAAI'24 paper: LatestEval: Addressing data contamination through dynamic and time-sensitive test construction.
If you find this collection helpful, please consider cite this paper:
@inproceedings{li2024latesteval,
title={Latesteval: Addressing data contamination in language model evaluation through dynamic and time-sensitive test construction},
author={Li, Yucheng and Guerin, Frank and Lin, Chenghua},
booktitle={Proceedings of the AAAI Conference on Artificial Intelligence},
volume={38},
number={17},
pages={18600--18607},
year={2024}
}