jacobli/studybench

studybench studybench is a small, high-effort benchmark of expert-level coding questions about real open-source codebases, each paired with a gold answer and a weighted, source-grounded grading rubric. The questions ask a model to produce working code that uses a specific library/framework correctly; the rubric decomposes a correct answer into discrete, checkable claims, each tied to exact lines of the upstream source. This release publishes both the questions and the full… See the full description on the dataset page: https://huggingface.co/datasets/jacobli/studybench.