TaigoPedrosa/PortugueseMMLU
Dataset Components The dataset is partitioned into three discrete tables stored in CSV or Parquet format: Questions Recipes Evaluation Results Each component is described in detail below. Questions area domain question_number An integer index uniquely identifying each question inside the knowledge domain. translation_method English, Google Translate, GPT-3.5-Turbo, GPT-4o, Human question option_a, option_b, option_c, option_d Recipes… See the full description on the dataset page: https://huggingface.co/datasets/TaigoPedrosa/PortugueseMMLU.
Dataset Components
The dataset is partitioned into three discrete tables stored in CSV or Parquet format:
- Questions
- Recipes
- Evaluation Results
Each component is described in detail below.
Questions
- area
- domain
- question\_number
An integer index uniquely identifying each question inside the knowledge domain.
- translation\_method
English, Google Translate, GPT-3.5-Turbo, GPT-4o, Human
- question
- option\_a, option\_b, option\_c, option\_d
Recipes
- area
- domain
- question
An integer index corresponding to the target question number (identical to question_number in Questions).
- seed
The random seed employed to select the five example questions.
- 1st\_shot, 2nd\_shot, 3rd\_shot, 4th\_shot, 5th\_shot
Integer indices (question numbers) of the five example questions used. All five example indices belong to the same domain as the target question.
Evaluation Results
- area
- domain
- question
- translation\_method
- model
- generated\_text
- extracted\_answer
- expected\_answer
- is\_correct