hoololi/llm-agent-harness-reliability-next-prime
LLM Next Prime Harness Dataset This dataset contains raw observations from an experiment studying how the agent harness affects reliability when an LLM has access to a deterministic tool. The task is deliberately simple and objectively verifiable: What is the smallest prime number that is strictly greater than n? The deterministic tool computes the correct answer with a local Python next_prime(n) function. The experiment asks whether failures come from the model, the provider… See the full description on the dataset page: https://huggingface.co/datasets/hoololi/llm-agent-harness-reliability-next-prime.
046
