datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
BiasShadesInterested in contributing? Speak a language not represented here? Disagree with an annotation? Please submit feedback in the Community tab!
Dataset Card for BiasShades
Note: This dataset may NOT be used as training data in any form (pre-training, fine-tuning, post-training, etc.) without express permission from creators.
Dataset Details
Version: 1.0
License: SHADES 1 Montreal Data License
Dataset Description
728 stereotypes and associated… See the full description on the dataset page: https://huggingface.co/datasets/LanguageShades/BiasShades.fleurs-r-neucodec-all-languages
FLEURS-R NeuCodec All Languages
FLEURS-R metadata, source audio and precomputed NeuCodec speech tokens for 102
locales, plus a speaker label FLEURS itself does not ship.
Layout
data/{locale}-{split}.parquet — metadata, one row per utterance (this is what the
viewer shows).
audio/{locale}-{split}.zip — source FLEURS-R audio, 24kHz mono PCM16 WAV, members
named audio/{locale}/{split}/{id}.wav (the path column).
neucodec/{locale}-{split}-rank{N}.zip — NeuCodec… See the full description on the dataset page: https://huggingface.co/datasets/malaysia-ai/fleurs-r-neucodec-all-languages.HuggingFaceFW-finetranslations-100-languages-sample
Finetranslations 100 Language Sample Dataset
Subset of HuggingFaceFW/finetranslations with the top 100 languages by number of documents.
Configurations
all: 100 languages combined (100k rows), shuffled
100 individual language configs: 1000 rows each
Columns
Original columns + language (source language indicator which is the name of the config)
Usage
from datasets import load_dataset
dataset =… See the full description on the dataset page: https://huggingface.co/datasets/agentlans/HuggingFaceFW-finetranslations-100-languages-sample.indommlu-local-languages
IndoMMLU: Local Languages and Cultures (audited subset)
An audited, corrected subset of IndoMMLU
(Koto et al., 2023) covering the 9 Local Languages and Cultures subjects:
Indonesian primary and secondary school exam questions written in Balinese,
Banjarese, Dayak Ngaju, Javanese, Lampung, Madurese, Makassarese, and
Sundanese, plus one culture-knowledge subject on Minangkabau customs
(answered in standard Indonesian). This is not a dataset we created.
It is IndoMMLU's own subset… See the full description on the dataset page: https://huggingface.co/datasets/ibahasa/indommlu-local-languages.d1_math_multiple_languagesafrica-drc-democratic-republic-of-the-congo-languages-7667d70e
Democratic Republic of the Congo: Languages | Africa (DRC official open data)
560 rows - 1 Africa country - 2016 - Repackaged by Electric Sheep Africa
TL;DR
This dataset packages one official CSV resource from DRC as
ML-ready Parquet. The source file is the provenance boundary; all usable
indicators or tabular columns from the resource stay together in this repo.
About the source
Source: Democratic Republic of the Congo: Languages
Publisher:… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-drc-democratic-republic-of-the-congo-languages-7667d70e.africa-cabo-verde-cabo-verde-languages-fa0ed7df
Cabo Verde: Languages | Africa (Cabo Verde official open data)
32 rows - 1 Africa country - 2022 - Repackaged by Electric Sheep Africa
TL;DR
This dataset packages one official CSV resource from Cabo Verde as
ML-ready Parquet. The source file is the provenance boundary; all usable
indicators or tabular columns from the resource stay together in this repo.
About the source
Source: Cabo Verde: Languages
Publisher: CLEAR Global (previously… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-cabo-verde-cabo-verde-languages-fa0ed7df.africa-namibia-namibia-languages-1b71e7aa
Namibia: Languages | Africa (Namibia official open data)
404 rows - 1 Africa country - 2015 - Repackaged by Electric Sheep Africa
TL;DR
This dataset packages one official CSV resource from Namibia as
ML-ready Parquet. The source file is the provenance boundary; all usable
indicators or tabular columns from the resource stay together in this repo.
About the source
Source: Namibia: Languages
Publisher: CLEAR Global (previously Translators… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-namibia-namibia-languages-1b71e7aa.africa-drc-democratic-republic-of-the-congo-languages-40e817c8
Democratic Republic of the Congo: Languages | Africa (DRC official open data)
1,912 rows - 1 Africa country - 2016 - Repackaged by Electric Sheep Africa
TL;DR
This dataset packages one official CSV resource from DRC as
ML-ready Parquet. The source file is the provenance boundary; all usable
indicators or tabular columns from the resource stay together in this repo.
About the source
Source: Democratic Republic of the Congo: Languages
Publisher:… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-drc-democratic-republic-of-the-congo-languages-40e817c8.africa-drc-democratic-republic-of-the-congo-languages-d54ea434
Democratic Republic of the Congo: Languages | Africa (DRC official open data)
1,020 rows - 1 Africa country - 2016 - Repackaged by Electric Sheep Africa
TL;DR
This dataset packages one official CSV resource from DRC as
ML-ready Parquet. The source file is the provenance boundary; all usable
indicators or tabular columns from the resource stay together in this repo.
About the source
Source: Democratic Republic of the Congo: Languages
Publisher:… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-drc-democratic-republic-of-the-congo-languages-d54ea434.africa-botswana-botswana-languages-3ca84016
Botswana: Languages | Africa (Botswana official open data)
48 rows - 1 Africa country - 2015 - Repackaged by Electric Sheep Africa
TL;DR
This dataset packages one official CSV resource from Botswana as
ML-ready Parquet. The source file is the provenance boundary; all usable
indicators or tabular columns from the resource stay together in this repo.
About the source
Source: Botswana: Languages
Publisher: CLEAR Global (previously Translators… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-botswana-botswana-languages-3ca84016.africa-cabo-verde-cabo-verde-languages-85afa2e5
Cabo Verde: Languages | Africa (Cabo Verde official open data)
8 rows - 1 Africa country - 2022 - Repackaged by Electric Sheep Africa
TL;DR
This dataset packages one official CSV resource from Cabo Verde as
ML-ready Parquet. The source file is the provenance boundary; all usable
indicators or tabular columns from the resource stay together in this repo.
About the source
Source: Cabo Verde: Languages
Publisher: CLEAR Global (previously… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-cabo-verde-cabo-verde-languages-85afa2e5.africa-namibia-namibia-languages-ba405147
Namibia: Languages | Africa (Namibia official open data)
1,080 rows - 1 Africa country - 2015 - Repackaged by Electric Sheep Africa
TL;DR
This dataset packages one official CSV resource from Namibia as
ML-ready Parquet. The source file is the provenance boundary; all usable
indicators or tabular columns from the resource stay together in this repo.
About the source
Source: Namibia: Languages
Publisher: CLEAR Global (previously Translators… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-namibia-namibia-languages-ba405147.africa-botswana-botswana-languages-89cc4e07
Botswana: Languages | Africa (Botswana official open data)
272 rows - 1 Africa country - 2015 - Repackaged by Electric Sheep Africa
TL;DR
This dataset packages one official CSV resource from Botswana as
ML-ready Parquet. The source file is the provenance boundary; all usable
indicators or tabular columns from the resource stay together in this repo.
About the source
Source: Botswana: Languages
Publisher: CLEAR Global (previously Translators… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-botswana-botswana-languages-89cc4e07.africa-eswatini-eswatini-languages-945cef34
Eswatini: Languages | Africa (Eswatini official open data)
12 rows - 1 Africa country - 2023 - Repackaged by Electric Sheep Africa
TL;DR
This dataset packages one official CSV resource from Eswatini as
ML-ready Parquet. The source file is the provenance boundary; all usable
indicators or tabular columns from the resource stay together in this repo.
About the source
Source: Eswatini: Languages
Publisher: CLEAR Global (previously Translators… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-eswatini-eswatini-languages-945cef34.africa-namibia-namibia-languages-d8f3cb75
Namibia: Languages | Africa (Namibia official open data)
64 rows - 1 Africa country - 2015 - Repackaged by Electric Sheep Africa
TL;DR
This dataset packages one official CSV resource from Namibia as
ML-ready Parquet. The source file is the provenance boundary; all usable
indicators or tabular columns from the resource stay together in this repo.
About the source
Source: Namibia: Languages
Publisher: CLEAR Global (previously Translators without… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-namibia-namibia-languages-d8f3cb75.africa-zimbabwe-zimbabwe-languages-a0930092
Zimbabwe: Languages | Africa (Zimbabwe official open data)
44 rows - 1 Africa country - 2023 - Repackaged by Electric Sheep Africa
TL;DR
This dataset packages one official CSV resource from Zimbabwe as
ML-ready Parquet. The source file is the provenance boundary; all usable
indicators or tabular columns from the resource stay together in this repo.
About the source
Source: Zimbabwe: Languages
Publisher: CLEAR Global (previously Translators… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-zimbabwe-zimbabwe-languages-a0930092.africa-botswana-botswana-languages-033359e6
Botswana: Languages | Africa (Botswana official open data)
372 rows - 1 Africa country - 2015 - Repackaged by Electric Sheep Africa
TL;DR
This dataset packages one official CSV resource from Botswana as
ML-ready Parquet. The source file is the provenance boundary; all usable
indicators or tabular columns from the resource stay together in this repo.
About the source
Source: Botswana: Languages
Publisher: CLEAR Global (previously Translators… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-botswana-botswana-languages-033359e6.africa-zimbabwe-zimbabwe-languages-d168da31
Zimbabwe: Languages | Africa (Zimbabwe official open data)
188 rows - 1 Africa country - 2023 - Repackaged by Electric Sheep Africa
TL;DR
This dataset packages one official CSV resource from Zimbabwe as
ML-ready Parquet. The source file is the provenance boundary; all usable
indicators or tabular columns from the resource stay together in this repo.
About the source
Source: Zimbabwe: Languages
Publisher: CLEAR Global (previously Translators… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-zimbabwe-zimbabwe-languages-d168da31.evals-for-every-language-languagesafrica-eswatini-eswatini-languages-c2db0118
Eswatini: Languages | Africa (Eswatini official open data)
12 rows - 1 Africa country - 2023 - Repackaged by Electric Sheep Africa
TL;DR
This dataset packages one official CSV resource from Eswatini as
ML-ready Parquet. The source file is the provenance boundary; all usable
indicators or tabular columns from the resource stay together in this repo.
About the source
Source: Eswatini: Languages
Publisher: CLEAR Global (previously Translators… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-eswatini-eswatini-languages-c2db0118.africa-eswatini-eswatini-languages-6467d8b0
Eswatini: Languages | Africa (Eswatini official open data)
40 rows - 1 Africa country - 2023 - Repackaged by Electric Sheep Africa
TL;DR
This dataset packages one official CSV resource from Eswatini as
ML-ready Parquet. The source file is the provenance boundary; all usable
indicators or tabular columns from the resource stay together in this repo.
About the source
Source: Eswatini: Languages
Publisher: CLEAR Global (previously Translators… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-eswatini-eswatini-languages-6467d8b0.abdullahkhan70_github-tech-stack-languages-and-frameworks
GitHub Tech Stack Languages & Frameworks
Comprehensive Repository Data: JavaScript, Python, Go, Rust & More
Dataset Info
Source: Kaggle
Original Size: 2.17 MB
Kaggle Downloads: 62
Files: 17
Files
Mirrored from Kaggle
multi-open
African Languages Lab Multi-Open
multi-open is the open-source multilingual subset released by the
African Languages Lab. It contains English-target
parallel text for 31 African languages.
Project website: https://the-african-languages-lab.github.io/
The African Languages Lab: A Collaborative Approach to Advancing Low-Resource African
NLPIssaka et al., ACL 2026.
The paper presents All Lab's broader collaborative program: systematic and quality-controlled
data infrastructure… See the full description on the dataset page: https://huggingface.co/datasets/African-Languages-Lab/multi-open.africa-malawi-languages
Malawi: Languages | Africa (original)
Size category: n<1K - Formats: parquet - Sector: demographics_social - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets help analysts inspect structured evidence… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-malawi-languages.africa-angola-languages
Angola: Languages | Africa (original)
Size category: n<1K - Formats: parquet - Sector: demographics_social - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets help analysts inspect structured evidence… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-angola-languages.africa-sudan-languages
Sudan: Languages | Africa (original)
Size category: n<1K - Formats: parquet - Sector: demographics_social - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets help analysts inspect structured evidence, build… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-sudan-languages.africa-mali-mali-languages-447e5f73
Mali: Languages | Africa (Mali official open data)
3,188 rows - 1 Africa country - 2009 - Repackaged by Electric Sheep Africa
TL;DR
This dataset packages one official CSV resource from Mali as
ML-ready Parquet. The source file is the provenance boundary; all usable
indicators or tabular columns from the resource stay together in this repo.
About the source
Source: Mali: Languages
Publisher: CLEAR Global (previously Translators without Borders)… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-mali-mali-languages-447e5f73.africa-mozambique-languages
Mozambique: Languages | Africa (original)
Size category: n<1K - Formats: parquet - Sector: demographics_social - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets help analysts inspect structured evidence… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-mozambique-languages.languages_datasetThis dataset contains a set of 8612 languages from across the world as well as data such as Glottocode, ISO-639-3 codes, names, language families etc.
Original source: https://glottolog.org/glottolog/language