openai/gsm8k
Dataset Card for GSM8K Dataset Summary GSM8K (Grade School Math 8K) is a dataset of 8.5K high quality linguistically diverse grade school math word problems. The dataset was created to support the task of question answering on basic mathematical problems that require multi-step reasoning. These problems take between 2 and 8 steps to solve. Solutions primarily involve performing a sequence of elementary calculations using basic arithmetic operations (+ − ×÷) to… See the full description on the dataset page: https://huggingface.co/datasets/openai/gsm8k.
1.7k1.2m
1# yaml file for compatibility with inspect-ai2 3name: GSM8K4description: >5 GSM8K is a dataset of 8,000+ high-quality, single-step arithmetic word problems.6evaluation_framework: inspect-ai7 8tasks:9 - id: gsm8k10 config: main11 split: test12 13 epochs: 414 epoch_reducer: pass_at_115 16 field_spec:17 input: question18 target: answer19 20 solvers:21 - name: prompt_template22 args:23 template: >24 Solve the following math problem efficiently and clearly. The last line25 of your response should be of the following format: 'Therefore, the final26 answer is: $\\boxed{ANSWER}$. I hope it is correct' (without quotes)27 where ANSWER is just the final number or expression that solves the28 problem. Think step by step before answering.29 30 {prompt}31 - name: generate32 33 scorers:34 - name: model_graded_fact35