sinatras/pmpp-hard

PMPP-Hard Agent Evaluation Traces PMPP-Hard is a 69-task agentic GPU-kernel evaluation for testing whether autonomous coding agents can produce implementations that are both correct and performant. This dataset contains the complete nine-model campaign used in the PMPP-Hard release: 621 rollouts, with 69 task sessions for each model configuration. Maintained and released by Sinatras. Source repository: SinatrasC/pmpp-hard Prime environment and evaluations: PMPP-Hard on Prime… See the full description on the dataset page: https://huggingface.co/datasets/sinatras/pmpp-hard.