datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Global-MMLU-emb
Dataset Description
This is the GlobalMMLU with query embeddings, which can be used jointly with Multilingual Embeddings for Wikipedia in 300+ Languages for doing multilingual passage retrieval, since the vectors are calculated via the same embedder Cohere Embed v3.
For more details about Global-MMLU, see the official dataset repo.
If you use our embedded queries, we kindly ask you to cite our work in which we created these embeddings:
@inproceedings{qi-etal-2025-consistency… See the full description on the dataset page: https://huggingface.co/datasets/JRQi/Global-MMLU-emb.global-censorship-index
Voidly Global Censorship Index
Real-time internet censorship measurements for 200 countries, based on 38,780,449+ OONI network probes.
Dataset Description
The Global Censorship Index provides country-level internet censorship scores derived from actual network measurements. Unlike annual expert assessments, this data updates daily.
Key Statistics
Countries covered: 200
Total measurements: 38,780,449
Severe censorship: 1 countries
High censorship: 6… See the full description on the dataset page: https://huggingface.co/datasets/emperor-mew/global-censorship-index.powertron-global-permafrost-corpus
Dataset Card: Powertron Global PermaFrost Corpus
Important Disambiguation: This corpus documents PermaFrost® NMR, a trademarked HVAC efficiency treatment product. It contains HVAC/refrigeration efficiency data (chillers, RTUs, DX systems, refrigeration). This corpus has NO connection to geological permafrost (frozen ground), climate science, or Arctic research. The name "PermaFrost" is a product trademark reflecting thermal transfer properties, not a geological term.… See the full description on the dataset page: https://huggingface.co/datasets/powertronglobal/powertron-global-permafrost-corpus.global-seo-knowledgeglobal-multilingual-cross-industry-corpus
Global Multilingual Cross-Industry Corpus
A highly structured, clean, and comprehensive cross-industry text corpus compiled across specialized enterprise domains, covering multiple manufacturing sectors and global languages. This dataset is explicitly optimized for Vertical Industry LLM Fine-tuning, Multi-lingual Machine Translation (MT), Domain-Specific RAG (Retrieval-Augmented Generation) systems, and AI crawler evaluation.
📊 Dataset Overview
Unlike mixed… See the full description on the dataset page: https://huggingface.co/datasets/Susan2026/global-multilingual-cross-industry-corpus.globalvoices_pairsGlobalQAhistoire-general-afrique-global-adaption
This dataset is a remastered version of this dataset prepared using Adaption's Adaptive Data platform.
Svngoku/Histoire-General-Afrique-Global
This dataset contains French-language text excerpts detailing the political, social, and economic history of Africa from the 16th to the 18th centuries. The content covers specific regions such as the Lower Guinea Coast and the Zambezi, discussing topics like ethnic migrations, kingdom formations, and trade dynamics. Each sample consists… See the full description on the dataset page: https://huggingface.co/datasets/MaatAI/histoire-general-afrique-global-adaption.Global-MMLU-Lite
Global MMLU-Lite — Human Translated
Global MMLU-Lite is a multilingual
evaluation benchmark for LLMs covering 18 languages. This dataset extends it with professional
human translations for three additional low-resource languages that are not in the original:
Chichewa (nya), Māori (mri), and Inuktitut (iku).
Released as part of the BYOL: Bring Your Own Language Into LLMs
project (paper).
What's New
The original Global MMLU-Lite by Cohere
covers 18 languages: Arabic… See the full description on the dataset page: https://huggingface.co/datasets/ai-for-good-lab/Global-MMLU-Lite.global_mmlu_lite_pt
🌎 Global-MMLU Lite (Portuguese)
A Focused Benchmark for Portuguese-Language Reasoning in Large Language Models
Global-MMLU Lite (Portuguese) is a curated subset of the Global-MMLU Lite benchmark designed to evaluate the reasoning, knowledge, and multiple-choice question-answering capabilities of large language models in Portuguese, providing a diverse and computationally efficient collection of translated and adapted QA samples across domains such as general knowledge, science… See the full description on the dataset page: https://huggingface.co/datasets/sapiens-technology/global_mmlu_lite_pt.globalvoices_pairs_en_xGlobal_Healthcare_Jobs_FAQ
Global Healthcare Jobs FAQ — UK NHS Careers Nepali Q&A Dataset
1. Overview
This dataset is a Nepali-language (Devanagari script) collection of question–answer pairs in ShareGPT format, covering frequently asked questions about working in the UK's National Health Service (NHS) — aimed specifically at international/foreign healthcare workers (nurses, doctors, dentists, and other clinicians) seeking employment, registration, visas, and career guidance in the United… See the full description on the dataset page: https://huggingface.co/datasets/sabin1234/Global_Healthcare_Jobs_FAQ.GlobalUniversityHomePages
GlobalUniversityHomePages
全球高等院校主页与域名数据集：收录全球高校的官方主页、域名、名称与国家/地区信息，其中中国大陆高校额外包含中文校名和学校标识码。
数据集简介
本数据集面向「学校名称 → 官网 / 域名」的检索与匹配场景，可用于高校主页补全、域名归属识别、机构名称标准化、教育数据统计等任务。
覆盖范围：
13046 所高等院校/教育机构，分布在 201 个国家/地区
13217 个唯一域名，13025 个唯一官方主页链接
12809 条记录带官方主页（约 98.2%）
中国大陆高校 3167 所，覆盖 31 个省级行政区，其中普通高校 2919 所、成人高校 248 所
4532 条记录带有省/州一级行政区信息
记录数最多的国家/地区：
国家/地区
记录数
中国
3185
美国
2348
日本
572
印度
477
德国
321
俄罗斯
308
法国
294
韩国
244
印度尼西亚
194
英国
193… See the full description on the dataset page: https://huggingface.co/datasets/XUEHANGAI/GlobalUniversityHomePages.global-news-reports-v1
This dataset is a remastered version of this dataset prepared using Adaption's Adaptive Data platform.
global_news_reports
This dataset comprises news articles covering major international events, with a significant focus on natural disasters in Turkey and Syria, geopolitical tensions involving Russia and Iran, and human interest stories. The texts provide detailed accounts of casualties, political responses, and survivor experiences drawn from various global sources. Each… See the full description on the dataset page: https://huggingface.co/datasets/sarahooker/global-news-reports-v1.global-news-reports
This dataset is a remastered version of this dataset prepared using Adaption's Adaptive Data platform.
global_news_reports
This dataset comprises news articles covering major international events, with a significant focus on natural disasters in Turkey and Syria, geopolitical tensions involving Russia and Iran, and human interest stories. The texts provide detailed accounts of casualties, political responses, and survivor experiences drawn from various global sources. Each… See the full description on the dataset page: https://huggingface.co/datasets/sarahooker/global-news-reports.adaption-v5-global-employment-law-qa
WorkRight V5 — Global Employment Law QA
1,751 employment-law reasoning examples across five jurisdictions, with a
deterministic gold path and no language model anywhere in it.
sha256: 2e828767c42a9f5ff53083509bacf6b1313e86027d418048376ac9441e25a456
— byte-identical to the artefact evaluated on Adaption.
1. Dataset Summary
Every statutory answer here is produced by an executable rule that reads a
fact scenario and returns a structured record — eligibility, amount… See the full description on the dataset page: https://huggingface.co/datasets/sahilmaniyar888/adaption-v5-global-employment-law-qa.GlobalDentBench-OAhistoire-general-afrique-global-adaption
This dataset is a remastered version of this dataset prepared using Adaption's Adaptive Data platform.
Svngoku/Histoire-General-Afrique-Global
This dataset contains French-language text excerpts detailing the political, social, and economic history of Africa from the 16th to the 18th centuries. The content covers specific regions such as the Lower Guinea Coast and the Zambezi, discussing topics like ethnic migrations, kingdom formations, and trade dynamics. Each sample consists… See the full description on the dataset page: https://huggingface.co/datasets/Svngoku/histoire-general-afrique-global-adaption.repro-decentralized-bandits-without-global-clock-for-dynamic-matching-market-traces
Agent traces
Agent sessions published from a Trackio Logbook.
Educational-Flashcards-for-Global-Learners
1. Educational-Flashcards-for-Global-Learners/README.md
Educational Flashcards Dataset
Overview
A comprehensive collection of 100 educational flashcards covering STEM, humanities, law, arts, and cultural topics. Curated with 70% Indian content, 25% European, and 5% other Asian perspectives to promote diverse knowledge representation.
Dataset Structure
{
"input": "Text description",
"output": {
"type": "flashcards",
"topic": "Subject name"… See the full description on the dataset page: https://huggingface.co/datasets/Srinivasmec26/Educational-Flashcards-for-Global-Learners.adaption-v3-global-workplace-law-qa
This dataset is a remastered version prepared using Adaption's Adaptive Data platform.
adaption-V3_global_workplace_law_qa
This dataset contains question-and-answer pairs regarding workplace rights, employment laws, and benefit calculations across various jurisdictions including the US, UAE, India, and the UK. Each sample provides specific legal citations, step-by-step mathematical derivations for owed amounts, and references to relevant government authorities. The content… See the full description on the dataset page: https://huggingface.co/datasets/sahilmaniyar888/adaption-v3-global-workplace-law-qa.global-products
Pricelists.org Global Product Dataset
International product dataset: identifiers, brand, category, a price snapshot and stable links back to the live Pricelists.org product, offers and API.
Release: 2026-09
Schema: pricelists-product-v1
Records: 10,755,957
Generated: 2026-09-21
License: CC-BY-4.0
Catalog: https://pricelists.org/en/datasets/global-products
Fields
Field
Type
Meaning
product_id
string
Stable join key; also the key to the offer dataset.… See the full description on the dataset page: https://huggingface.co/datasets/price-lists/global-products.global-africa-history-qa
This dataset is a remastered version of this dataset prepared using Adaption's Adaptive Data platform.
global_africa_history_qa
This dataset contains question-answer pairs derived from books and documents focusing on African history, politics, and socio-economic development since 1935. The content covers diverse topics including military operations, structural adjustment programs, agricultural development, and key historical figures across various African nations. Samples… See the full description on the dataset page: https://huggingface.co/datasets/Svngoku/global-africa-history-qa.global-offers
Pricelists.org Global Offer Dataset
Offers behind the Pricelists.org product dataset: merchant, price, availability and a Pricelists redirect URL. Join to the product dataset on product_id.
Release: 2026-09
Schema: pricelists-offer-v1
Records: 45,752,717
Generated: 2026-09-21
License: CC-BY-4.0
Catalog: https://pricelists.org/en/datasets/global-offers
Fields
Field
Type
Meaning
offer_id
string
Stable offer identifier.
product_id
string
Join key to… See the full description on the dataset page: https://huggingface.co/datasets/price-lists/global-offers.finance-trading-global
Global Finance & Trading Dataset
400+ expert-level finance and trading instruction samples covering options, forex, equities, crypto, and quant strategies.
Stats
Samples: 64
Format: JSONL (messages format, ready for SFT)
License: Apache 2.0
Usage
from datasets import load_dataset
ds = load_dataset("paijo77/finance-trading-global")
# Format: messages array
print(ds['train'][0]['messages'])
Fine-tuning
from trl import SFTTrainer
#… See the full description on the dataset page: https://huggingface.co/datasets/oyi77/finance-trading-global.global-robots-txt-ai-blocking-stats
Global robots.txt AI Bot Blocking Statistics (2026)
Aggregated sector-by-sector statistical index of AI Crawler blocking policies (opt-out rate) based on analysis of robots.txt directives across 50,000 global target domains.
Published by Pixel Office EU.
Included Sectors
News & Publishing
SaaS & Tech
Finance & Banking
E-Commerce
Healthcare & Medical
Travel & Hospitality
Blogs & Personal Sites
🚨 Is Your Domain Blocked or Misconfigured for AI… See the full description on the dataset page: https://huggingface.co/datasets/pixeloffice/global-robots-txt-ai-blocking-stats.global_mmlu_lite
🌍 Global-MMLU Lite Dataset
A Lightweight Benchmark for Multi-Domain Reasoning in Large Language Models
Global-MMLU Lite is a curated and efficient subset of the Global Massive Multitask Language Understanding (MMLU) benchmark, designed to evaluate and fine-tune large language models across a wide range of academic and professional domains through high-quality multiple-choice question answering; preserving the diversity and rigor of the original benchmark while significantly… See the full description on the dataset page: https://huggingface.co/datasets/sapiens-technology/global_mmlu_lite.global_mmlu_lite_en
🌍 Global-MMLU Lite (English Only)
A Focused Benchmark for English-Language Reasoning in Large Language Models
Global-MMLU Lite (English Only) is a curated subset of the Global-MMLU Lite benchmark specifically designed to evaluate the reasoning, knowledge, and multiple-choice question-answering capabilities of large language models within the English language, providing a diverse yet computationally efficient collection of structured QA samples spanning domains such as science… See the full description on the dataset page: https://huggingface.co/datasets/sapiens-technology/global_mmlu_lite_en.hallo3_with_promptHallo3: Highly Dynamic and Realistic Portrait Image Animation with Diffusion Transformer Networks
Jiahao Cui1
Hui Li1
Yun Zhan1
Hanlin Shang1
Kaihui Cheng1
Yuqi Ma1
Shan Mu1
Hang Zhou2
Jingdong Wang2
Siyu Zhu1✉️
1Fudan University 2Baidu Inc
I. Dataset Overview
This dataset serves as the training data for the open - source Hallo3 model, specifically created for the training of video… See the full description on the dataset page: https://huggingface.co/datasets/global-optima-research/hallo3_with_prompt.2025-global-events-qa
This dataset is a remastered version of this dataset prepared using Adaption's Adaptive Data platform.
2025_global_events_qa
This dataset contains question-answer pairs detailing significant fictional global events, political developments, and crises that occurred throughout the year 2025. The content covers diverse domains including international diplomacy, military conflicts, sports championships, trade policies, and disaster responses. Each entry provides a specific prompt… See the full description on the dataset page: https://huggingface.co/datasets/Reubencf/2025-global-events-qa.