akshathmangudi/SciCode

Dataset Card for Dataset Name Official Description (from the authors): Since language models (LMs) now outperform average humans on many challenging tasks, it has become increasingly difficult to develop challenging, high-quality, and realistic evaluations. We address this issue by examining LMs' capabilities to generate code for solving real scientific research problems. Incorporating input from scientists and AI researchers in 16 diverse natural science sub-fields… See the full description on the dataset page: https://huggingface.co/datasets/akshathmangudi/SciCode.