Datasetpublic

microsoft/SWE-Sharp-Bench

SWE-Sharp-Bench SWE-Sharp-Bench is a comprehensive benchmark suite for evaluating software engineering capabilities of AI agents and models on C# and .NET codebases. This benchmark extends the SWE-Bench framework to the C# ecosystem, providing real-world software engineering tasks from popular open-source repositories. Code - https://github.com/microsoft/prose/tree/main/misc/SWE-Sharp-Bench Research Paper Draft & Benchmark Analysis: https://aka.ms/swesharparxiv… See the full description on the dataset page: https://huggingface.co/datasets/microsoft/SWE-Sharp-Bench.

sourceHugging Facecdla-permissive-2.0updated 11mo agoView on Hugging Face

3likes569downloads

Dataset Card

SWE-Sharp-Bench

SWE-Sharp-Bench is a comprehensive benchmark suite for evaluating software engineering capabilities of AI agents and models on C# and .NET codebases. This benchmark extends the SWE-Bench framework to the C# ecosystem, providing real-world software engineering tasks from popular open-source repositories.

Code - https://github.com/microsoft/prose/tree/main/misc/SWE-Sharp-Bench

Research Paper Draft & Benchmark Analysis: https://aka.ms/swesharparxiv

Contact

If you have suggestions or any questions, please raise an issue on Github or contact us at t-smhatre@microsoft.com .

Citation

If you find our work helpful for your research, please consider citing our work.

@misc{mhatre2025swesharpbenchreproduciblebenchmarkc,
      title={SWE-Sharp-Bench: A Reproducible Benchmark for C# Software Engineering Tasks}, 
      author={Sanket Mhatre and Yasharth Bajpai and Sumit Gulwani and Emerson Murphy-Hill and Gustavo Soares},
      year={2025},
      eprint={2511.02352},
      archivePrefix={arXiv},
      primaryClass={cs.SE},
      url={https://arxiv.org/abs/2511.02352}, 
}