janewarrenn/CAMP

CAMP: Contextualized Arithmetic with Minimal Pairs CAMP is a benchmark for studying how natural language framing affects LLM accuracy on unit conversion tasks. Each item is a minimal pair: the same underlying computation presented in multiple surface forms, allowing direct comparison of model behavior across prompt conditions while holding the math constant. Key Finding LLMs answer unit conversion questions significantly less accurately when the problem is framed… See the full description on the dataset page: https://huggingface.co/datasets/janewarrenn/CAMP.