datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
hle-multilingual
HLE Multilingual
Multilingual translations of HLE (Humanity's Last Exam), an expert-level QA benchmark with questions across math, science, humanities, and engineering designed to challenge even domain experts.
Source: cais/hle (test split, 2,158 text-only questions out of 2,500 total)
Languages
Config
Language
Examples
ces
Czech
50
dan
Danish
50
deu
German
800
fin
Finnish
50
fra
French
50
ita
Italian
50
nld
Dutch
50
pol
Polish
50
spa… See the full description on the dataset page: https://huggingface.co/datasets/ellamind/hle-multilingual.gsm8k-platinum-multilingual
GSM8K Platinum Multilingual
Multilingual translations of GSM8K Platinum, a rigorously cleaned and verified version of GSM8K containing 1,209 elementary math word problems requiring multi-step arithmetic reasoning.
Source: madrylab/gsm8k-platinum (test split, 1,209 questions)
Languages
Config
Language
Examples
ces
Czech
100
dan
Danish
100
deu
German
1,209
fin
Finnish
100
fra
French
100
ita
Italian
100
nld
Dutch
100
pol
Polish
100
spa
Spanish… See the full description on the dataset page: https://huggingface.co/datasets/ellamind/gsm8k-platinum-multilingual.tiny-aya-l2-thinker-multilingual-reasoning
Tiny Aya L2 Multilingual Reasoning (44 languages)
Translated multilingual reasoning traces used to train Tiny Aya L2-Thinker.
Each example has the prompt, thinking, and answer in the same non-English language alongside the original texts in English.
Data source
Prompts from AM-DeepSeek-R1-0528-Distilled
Thinking traces and outputs distilled from gpt-oss-120b
Translated with command-a-translate and DeepSeek-V3
Languages (44)
Language
Train… See the full description on the dataset page: https://huggingface.co/datasets/CohereLabs/tiny-aya-l2-thinker-multilingual-reasoning.TrueFalse-Statements-multilingualThis dataset is introduced in the paper Analyzing LLMs' Knowledge Boundary Cognition Across Languages Through the Lens of Internal Representations.
Code: https://github.com/DAMO-NLP-SG/LLM-Multilingual-Knowledge-Boundaries
gsm8k-multilingual-reasoning
gsm8k-multilingual-reasoning
GSM8K with reasoning translated to multiple languages
Schema
{"prompt": "...", "answer": "...", "reasoning": "...", "metadata": {...}}
Usage
from datasets importload_dataset
ds = load_dataset("eddie-OB/gsm8k-multilingual-reasoning")
print(ds["train"][0])
Source
Derived from OpenAI GSM8K.
MedQA-Darija-MultiLingual
MedQA-Darija-MultiLingual
The largest open trilingual medical Q&A dataset with directly-playable speech audio for English, French, and Moroccan Darija.
A research dataset for the BRAIN HEALTH initiative, designed for multilingual medical NLP, low-resource speech recognition, healthcare chatbots, and clinical education tools targeting Morocco and the broader Maghreb region.
Dataset is currently in scientific validation phase. After programmatic validation (Stage 1 LOF outlier… See the full description on the dataset page: https://huggingface.co/datasets/Williamsanderson/MedQA-Darija-MultiLingual.remote_sensing_VQA_multilingual
Remote Sensing VQA — Multilingual
A multilingual counterfactual MCQ dataset built from remote sensing / satellite imagery.
Each row contains a satellite image, two captions (original vs counterfactual), and a multiple-choice question probing whether a VLM follows the image or the misleading text.
Languages
Language
Code
Rows
English
en
50
Hindi
hi
50
Urdu
ur
50
Telugu
te
50
Bahasa Indonesia
id
50
Columns
Column
Type… See the full description on the dataset page: https://huggingface.co/datasets/apart-global-south-hack/remote_sensing_VQA_multilingual.gpqa-multilingual
GPQA Multilingual
Multilingual translations of GPQA (Graduate-Level Google-Proof Q&A), a challenging multiple-choice benchmark requiring graduate-level expertise in biology, physics, and chemistry.
Source: Idavidrein/gpqa (gpqa_main, 448 questions)
Languages
Config
Language
Examples
ces
Czech
448
dan
Danish
448
deu
German
448
fin
Finnish
50
fra
French
448
ita
Italian
448
nld
Dutch
448
pol
Polish
448
spa
Spanish
448
More to be added later.… See the full description on the dataset page: https://huggingface.co/datasets/ellamind/gpqa-multilingual.gsm8k-multilingual
gsm8k-multilingual
GSM8K translated to multiple languages (no reasoning)
Schema
{"prompt": "...", "answer": "...", "metadata": {...}}
Usage
from datasets import load_dataset
ds = load_dataset("eddie-OB/gsm8k-multilingual")
print(ds["train"][0])
Source
Derived from OpenAI GSM8K.
simpleqa-verified-multilingual
SimpleQA Verified Multilingual
Multilingual translations of SimpleQA Verified, a 1,000-prompt factuality benchmark from Google DeepMind that evaluates short-form parametric knowledge (facts stored in model weights).
Source: google/simpleqa-verified (eval split, 1,000 examples)
Languages
Config
Language
Examples
ces
Czech
100
dan
Danish
100
deu
German
1,000
fra
French
100
ita
Italian
100
nld
Dutch
100
pol
Polish
100
spa
Spanish
100
More to… See the full description on the dataset page: https://huggingface.co/datasets/ellamind/simpleqa-verified-multilingual.multilingual-queries-2026
MAST Multilingual Queries 2026
This dataset contains the multilingual query set for MAST @ FIRE 2026, the Multilingual Agentic Search Track. MAST evaluates whether multilingual agentic search systems can answer complex questions posed in different languages.
MAST builds on BrowseComp-Plus (ACL 2026), a reproducible and verifiable extension of BrowseComp with challenging English queries, a verified English corpus of roughly 100K web-sourced documents, and human judgments. In the… See the full description on the dataset page: https://huggingface.co/datasets/mast-benchmark/multilingual-queries-2026.tiny-aya-l2-thinker-multilingual-reasoning
Tiny Aya L2 Multilingual Reasoning (44 languages)
Translated multilingual reasoning traces used to train Tiny Aya L2-Thinker.
Each example has the prompt, thinking, and answer in the same non-English language alongside the original texts in English.
Languages (44)
Language
Train
Test
Total
Amharic (am)
3,807
448
4,255
Arabic (ar)
22,968
2,538
25,506
Bulgarian (bg)
4,177
452
4,629
Bengali (bn)
3,803
422
4,225
Catalan (ca)
4,251
512
4,763
Czech… See the full description on the dataset page: https://huggingface.co/datasets/erenyeager-1/tiny-aya-l2-thinker-multilingual-reasoning.FinanceComplexQA
Finance-ComplexQA
Finance-ComplexQA is a bilingual Chinese-English benchmark for complex question answering in the financial domain. It is designed to evaluate whether large language models and agent systems can answer finance questions by grounding their reasoning in reference documents rather than relying only on parametric knowledge.
The dataset covers multiple financial document domains and reasoning skills, including retrieval, multi-hop reasoning, numerical calculation… See the full description on the dataset page: https://huggingface.co/datasets/Multilingual-Multimodal-NLP/FinanceComplexQA.counterfactual-pendulum-multilingual
📌 Dataset Summary
When a Vision-Language Model (VLM) is given an image along with a text prompt containing contradictory or misleading information, how does it react? Does it rely on the visual evidence, succumb to textual bias, or honestly abstain when faced with unresolvable conflict?
This dataset adapts the Counterfactual Pendulum scenario across two visual conflict dimensions:
Angular (Angle): Conflict in the pendulum's angle of inclination.
Light: Conflict in the light… See the full description on the dataset page: https://huggingface.co/datasets/apart-global-south-hack/counterfactual-pendulum-multilingual.multilingual-knowledge-training-pool
Multilingual knowledge training pool
Public multiple-choice questions in many languages from seven datasets, read at the pinned
revisions named below and laid out twice. Train on either layer or on both.
pool.jsonl
Every source rewritten into one shape, 328665 rows in 116 languages, one JSON object per line,
with these fields.
Field
What it holds
id
a row identifier unique within this file
question
the question text, as its source publishes it… See the full description on the dataset page: https://huggingface.co/datasets/Emulated-Inc/multilingual-knowledge-training-pool.RAG_Multilingual
Dataset Card for RAG_Multilingual
Dataset Summary
RAG_Multilingual is an instruction-following synthetic QA dataset created from extractive QA datasets from Catalan, English and Spanish reference sets.
The reference datasets were: SQAD (https://huggingface.co/datasets/rajpurkar/squad), Catalanqa (https://huggingface.co/datasets/projecte-aina/catalanqa) and SQAC (https://huggingface.co/datasets/PlanTL-GOB-ES/SQAC).
This dataset, of 56.406 instances, was created by… See the full description on the dataset page: https://huggingface.co/datasets/projecte-aina/RAG_Multilingual.code-conflict
Code Conflict Dataset
A dataset of 100 visual Python code conflict samples designed to evaluate Vision-Language Models (VLMs) under cross-modal conflicts (discrepancy between code screenshots and caption text).
Dataset Statistics
Total Rows: 100 samples
Language: English (english)
Categories: 5 distinct Python code conflict_types (20 samples per category):
operator_substitution (Rows 1–20): Swapping math or logic operators (e.g., + to -, == to !=, or to and).… See the full description on the dataset page: https://huggingface.co/datasets/multilingual-vlm-conflict/code-conflict.multilingual_qaMultilingual instructional dataset for extractive QA finetunning for Catalan, Spanish and English, using SQAD, SQAC, CatalanQA and COQCAT datasets.
Contains almost 55K questions, answers and contexts, with development and train splits.
AutoMemoryBench
AutoMemoryBench
State-Contract Evaluation for Auditable Agent Memory
AutoMemoryBench evaluates whether an agent uses the right memory, and only
the admissible memory, under a query-time state contract. Each executable
contract partitions memory into required, admissible, and
prohibited sets. Prohibited memories are typed as superseded, deleted,
restricted, cross-namespace, or stale-tool.
Relevance is not enough: remembered evidence must also be… See the full description on the dataset page: https://huggingface.co/datasets/Multilingual-Multimodal-NLP/AutoMemoryBench.rpg-conflict
RPG Fantasy Battle Conflict Dataset
A dataset of 100 visual RPG combat conflict samples designed to evaluate Vision-Language Models (VLMs) under cross-modal conflicts (discrepancy between battle screenshots and caption text). Derived from the rcannizzaro/rpg_fantasy_battle_counterfactual_v2 dataset.
Dataset Statistics
This dataset consists of a single train split containing 100 perfectly isolated conflict samples derived from the… See the full description on the dataset page: https://huggingface.co/datasets/multilingual-vlm-conflict/rpg-conflict.Uganda-Multilingual-QA
BUAIR Uganda Multilingual Q&A
Parallel question–answer dataset for Ugandan languages, curated by the BUAIR Voice initiative at Busitema University.
Dataset version: v2 (updated 2026-08-31)
Each language config contains the same 4,256 agriculture / rural-livelihood Q&A pairs, with English as the shared source and translations into Japadhola, Ateso, Runyankore, and Luganda.
Changelog (v2)
Replaced v1 data (5,000 pairs from Multiligual-QA.xlsx) with cleaned data… See the full description on the dataset page: https://huggingface.co/datasets/BUAIR/Uganda-Multilingual-QA.Multilingual-BioASQ-6B
Mutilingual BioASQ-6B
We translate the BioASQ-6B English Question Answering dataset to generate parallel French, Italian and Spanish versions using the NLLB200 3B parameter model. For more info read the original task description: [http://bioasq.org/participate/challenges_year_6](http://bioasq.org/participate/challenges_year_6)
We translate the body, snippets, ideal_answer and exact_answer fields. We have validated the quality of the ideal_answer field, however, the… See the full description on the dataset page: https://huggingface.co/datasets/HiTZ/Multilingual-BioASQ-6B.synthetic_multilingual_llm_prompts
Image generated by DALL-E. See prompt for more details
📝🌐 Synthetic Multilingual LLM Prompts
Welcome to the "Synthetic Multilingual LLM Prompts" dataset! This comprehensive collection features 1,250 synthetic LLM prompts generated using Gretel Navigator, available in seven different languages. To ensure accuracy and diversity in prompts, and translation quality and consistency across the different languages, we employed Gretel Navigator both as a generation tool and as an… See the full description on the dataset page: https://huggingface.co/datasets/gretelai/synthetic_multilingual_llm_prompts.multilingual-elder-safety-msgs
multilingual-elder-safety-msgs
A hand-authored, multilingual elder fraud-recognition and safety coaching dataset. 467 curated scam/safe scenarios in Chinese and English, with platform-generated coaching responses localized across 5 languages: Chinese, English, Vietnamese, Khmer (Cambodian), and Lao. Expanded to 1,029 rows through Adaption Labs platform reasoning traces and multilingual adaptation.
Built for communities where filial piety, authority deference, and fear of… See the full description on the dataset page: https://huggingface.co/datasets/vanila434/multilingual-elder-safety-msgs.cs_squad-3.0
Dataset Card for Czech Simple Question Answering Dataset 3.0
This a processed and filtered adaptation of an existing dataset. For raw and larger dataset, see Dataset Source section.
Dataset Description
The data contains questions and answers based on Czech wikipeadia articles.
Each question has an answer (or more) and a selected part of the context as the evidence.
A majority of the answers are extractive - i.e. they are present in the context in the exact form. The… See the full description on the dataset page: https://huggingface.co/datasets/fewshot-goes-multilingual/cs_squad-3.0.DeepResearch-Bench-Multilingual
DeepResearch Bench Multilingual Prompts
This dataset provides prompt-level multilingual translations for the 100 research tasks used in muset-ai/DeepResearch-Bench-Dataset.
The translations cover eight languages:
en
zh
es
it
ar
bn
ja
el
What is included
This repository focuses on the benchmark prompts only.
On the Hugging Face Hub, the Dataset Viewer is configured with one default subset named all plus nine explicit subset configurations: source_prompt, en, zh, es… See the full description on the dataset page: https://huggingface.co/datasets/JRQi/DeepResearch-Bench-Multilingual.gpqa_diamond_multilingual
GPQA Diamond Multilingual
gpqa_diamond_multilingual is a multilingual version of the benchmark GPQA Diamond, covering six languages: English, French, German, Spanish, Chinese, and Swahili. Each sample is a graduate-level multiple-choice question in biology, physics, or chemistry, written and validated by domain experts, translated into the five target languages.
This release is a corrected version of shanchen/gpqa_diamond_mc_multilingual that fixes translation artifacts and errors.… See the full description on the dataset page: https://huggingface.co/datasets/lightonai/gpqa_diamond_multilingual.FreshQA-multilingualThis dataset is used in the paper Analyzing LLMs' Knowledge Boundary Cognition Across Languages Through the Lens of Internal Representations.
afrofinchain-multilingual-web3
AfroFinChain — Multilingual Web3 & Blockchain Dataset
Multilingual Web3 & blockchain dataset in Yoruba, Hausa, Igbo, and Nigerian Pidgin with 1,451 terminology entries and 1,451 conversational Q&A pairs. Designed for LLM fine-tuning, financial literacy, and conversational AI in low-resource African languages. Uses culturally grounded analogies (e.g., ajo, adashi, isusu) to make DeFi concepts actually understandable.
Built with Adaptive Data by Adaption as part of the Adaption… See the full description on the dataset page: https://huggingface.co/datasets/FirstBML1/afrofinchain-multilingual-web3.actuarial-global-glossary-multilingual
🤝 Connect with me on LinkedIn!
Join the mission to make actuarial knowledge accessible worldwide
Let's discuss how AI can transform professional education and break language barriers in finance!
🌍 Global Actuarial Glossary - Breaking Language Barriers in Finance
🚀 The World's Most Comprehensive Multilingual Actuarial Dataset
Imagine: A brilliant actuarial student in Tokyo, a risk analyst in São Paulo, and an insurance executive… See the full description on the dataset page: https://huggingface.co/datasets/manuelcaccone/actuarial-global-glossary-multilingual.