datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
gpqa_subtask
GPQA Subtask
This is an splitted version of the GPQA dataset, where different domains and subdomains are in different files.
Samples per subdomain in main:
biology 78
physics 187
chemistry 183
Samples per subdomain in diamond:
physics 86
chemistry 93
biology 19
Samples per subdomain in extended:
biology 105
physics 227
chemistry 214
Dataset Card for GPQA
GPQA is a multiple-choice, Q&A dataset of very hard questions written and validated by experts in biology… See the full description on the dataset page: https://huggingface.co/datasets/PNYX/gpqa_subtask.palmx_2025_subtask1_culture🏷️ PalmX 2025 — General Culture Evaluation (PalmX-GC)
Dataset Summary
PalmX-GC evaluates a model’s grasp of general Arab culture—customs, history, geography, arts, cuisine, notable figures, and everyday life across the 22 Arab League countries.
Every item is written in Modern Standard Arabic (MSA). The dataset powers Subtask 1 of the PalmX 2025 shared task.
Dataset Structure
Split
# MCQs
Release Date
Notes
Train
2000
10 Jun 2025
With gold answers
Dev
500
10… See the full description on the dataset page: https://huggingface.co/datasets/UBC-NLP/palmx_2025_subtask1_culture.finnlp2026-subtask3-polyfiqa
FinNLP 2026 Subtask 3 — PolyFiQA
Files:
train.parquet: 76 public labeled PolyFiQA examples supplied by the organizers.
test.parquet: 76 hidden-answer participant examples with stable row IDs.
SOURCE_DATASET_CARD.md: source PolyFiQA dataset documentation and citation.
task_id identifies a source financial-report document and repeats four times. The added id column is the unique submission key. Test answers remain in the private competition repository.
palmx_2025_subtask2_islamic
🏷️ PalmX 2025 — Islamic Culture Evaluation (PalmX-IC)
Dataset Summary
PalmX-IC assesses a model’s knowledge of Islamic culture—rituals, Qurʾān verses, Ḥadīth, historic events, jurisprudence, and religious holidays—core elements of life across the Arab world.All items are authored in Modern Standard Arabic (MSA) . The dataset powers Subtask 2 of the PalmX 2025 shared task.
Dataset Structure
Split
# MCQs
Release Date
Notes
Train
600
10 Jun 2025
With… See the full description on the dataset page: https://huggingface.co/datasets/UBC-NLP/palmx_2025_subtask2_islamic.