Northy1717/SWE-bench-Live

A brand-new, continuously updated SWE-bench-like dataset powered by an automated curation pipeline. For the official data release page, please see microsoft/SWE-bench-Live. Dataset Summary SWE-bench-Live is a live benchmark for issue resolving, designed to evaluate an AI system’s ability to complete real-world software engineering tasks. Thanks to our automated dataset curation pipeline, we plan to update SWE-bench-Live on a monthly basis to provide the… See the full description on the dataset page: https://huggingface.co/datasets/Northy1717/SWE-bench-Live.