microsoft/SWE-Sharp-Bench
SWE-Sharp-Bench SWE-Sharp-Bench is a comprehensive benchmark suite for evaluating software engineering capabilities of AI agents and models on C# and .NET codebases. This benchmark extends the SWE-Bench framework to the C# ecosystem, providing real-world software engineering tasks from popular open-source repositories. Code - https://github.com/microsoft/prose/tree/main/misc/SWE-Sharp-Bench Research Paper Draft & Benchmark Analysis: https://aka.ms/swesharparxiv… See the full description on the dataset page: https://huggingface.co/datasets/microsoft/SWE-Sharp-Bench.
3554
1---2license: cdla-permissive-2.03---4 5# SWE-Sharp-Bench 6 7SWE-Sharp-Bench is a comprehensive benchmark suite for evaluating software engineering capabilities of AI agents and models on C# and .NET codebases. This benchmark extends the SWE-Bench framework to the C# ecosystem, providing real-world software engineering tasks from popular open-source repositories.8 9Code - https://github.com/microsoft/prose/tree/main/misc/SWE-Sharp-Bench10 11Research Paper Draft & Benchmark Analysis: https://aka.ms/swesharparxiv12 13## Contact 14 15If you have suggestions or any questions, please raise an issue on Github or contact us at t-smhatre@microsoft.com .16 17## Citation 18 19If you find our work helpful for your research, please consider citing our work.20 21```22@misc{mhatre2025swesharpbenchreproduciblebenchmarkc,23 title={SWE-Sharp-Bench: A Reproducible Benchmark for C# Software Engineering Tasks}, 24 author={Sanket Mhatre and Yasharth Bajpai and Sumit Gulwani and Emerson Murphy-Hill and Gustavo Soares},25 year={2025},26 eprint={2511.02352},27 archivePrefix={arXiv},28 primaryClass={cs.SE},29 url={https://arxiv.org/abs/2511.02352}, 30}31```32 33 34