CoolFace
Datasetpublic

yhzhang3/papergym-verify

PaperGym — verification set Each row shows one scientific figure and asks for one number plotted in it. The gold answer was not read off the figure — it was recomputed from the source data table the paper published alongside it, by an LLM pipeline. Your job is to check whether that gold is actually the number the figure plots. The pipeline is good at arithmetic and bad at knowing when its own assumptions are wrong. Every defect found so far has the same shape: the recipe… See the full description on the dataset page: https://huggingface.co/datasets/yhzhang3/papergym-verify.

sourceHugging Faceupdated 22d agoView on Hugging Face
0likes107downloads
discussions and pull requests

Conversations for this repository live on Hugging Face.

CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.

Open discussions on Hugging Face
yhzhang3/papergym-verify · CoolFace