Maxscha/commitbench

CommitBench: A Benchmark for Commit Message Generation EXECUTIVE SUMMARY We provide CommitBench as an open-source, reproducible and privacy- and license-aware benchmark for commit message generation. The dataset is gathered from GitHub repositories with licenses that permit redistribution. We provide six programming languages, Java, Python, Go, JavaScript, PHP, and Ruby. The commit messages in natural language are restricted to English, as it is the working… See the full description on the dataset page: https://huggingface.co/datasets/Maxscha/commitbench.