datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
afrikaans-30s
Afrikaans Speech Dataset for Whisper Fine-Tuning
Dataset Card
Dataset Summary
This dataset consists of approximately 56 hours of Afrikaans speech extracted from church sermons, paired with cleaned and aligned transcripts. It is specifically prepared for fine-tuning multilingual ASR models like OpenAI's Whisper (particularly large-v3) on low-resource Afrikaans speech
The audio is segmented into fixed 30-second chunks (with 3-second overlaps for context… See the full description on the dataset page: https://huggingface.co/datasets/andreoosthuizen/afrikaans-30s.afrikaans_ner_corpus
Dataset Card for Afrikaans Ner Corpus
Dataset Summary
The Afrikaans Ner Corpus is an Afrikaans dataset developed by The Centre for Text Technology (CTexT), North-West University, South Africa. The data is based on documents from the South African goverment domain and crawled from gov.za websites. It was created to support NER task for Afrikaans language. The dataset uses CoNLL shared task annotation standards.
Supported Tasks and Leaderboards
[More… See the full description on the dataset page: https://huggingface.co/datasets/nwu-ctext/afrikaans_ner_corpus.afrikaans-english-emotions-corpus
Afrikaans-english Emotion Analysis Corpus
Dataset Description
This dataset contains emotion-labeled text data in Afrikaans-english for emotion classification (joy, sadness, anger, fear, surprise, disgust, neutral). Emotions were extracted and processed from the English meanings of the sentences using the model j-hartmann/emotion-english-distilroberta-base. The dataset is part of a larger collection of African language emotion analysis resources.
Dataset Statistics… See the full description on the dataset page: https://huggingface.co/datasets/michsethowusu/afrikaans-english-emotions-corpus.afrikaans-speech-datasetopenslr-32-hq-SA-languages-Afrikaans
High quality TTS data for four South African languages - Afrikaans
Source - https://openslr.org/32/
Identifier: SLR32
Summary: Multi-speaker TTS data for four South African languages - Afrikaans
License: Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)
About this resource:
This data set contains multi-speaker high quality transcribed audio data for four languages of South Africa. The data set consists of wave files, and a TSV file transcribing the audio.… See the full description on the dataset page: https://huggingface.co/datasets/voice-biomarkers/openslr-32-hq-SA-languages-Afrikaans.alpaca_afrikaans_tacoThis repository contains the dataset used for the TaCo paper.
The dataset follows the style outlined in the TaCo paper, as follows:
{
"instruction": "instruction in xx",
"input": "input in xx",
"output": "Instruction in English: instruction in en ,
Response in English: response in en ,
Response in xx: response in xx "
}
Please refer to the paper for more details: OpenReview
If you have used our dataset, please cite it as follows:
Citation… See the full description on the dataset page: https://huggingface.co/datasets/saillab/alpaca_afrikaans_taco.nichevault-afrikaans-asr-sample
NicheVault Afrikaans ASR — Free Sample
Overview
NicheVault Afrikaans ASR — Free Sample is a 20-clip preview of a 61.5-hour Whisper-ready Afrikaans ASR training dataset. Every clip is 16kHz mono WAV with a human-verified sentence-level transcript, formatted as JSONL metadata. All clips are pure CC BY — no ShareAlike, no copyleft obligations.
This sample is drawn from 20 clips across the full dataset's train/validation/test splits. It is provided unauthenticated… See the full description on the dataset page: https://huggingface.co/datasets/NicheVault/nichevault-afrikaans-asr-sample.afrikaans-english_sentence-pairsnchlt_speech_afrikaans
NCHLT Speech Corpus -- Afrikaans
This is the Afrikaans language part of the NCHLT Speech Corpus of the South African languages.
Language code (ISO 639): afr
URI: https://hdl.handle.net/20.500.12185/280
Licence:
Creative Commons Attribution 3.0 Unported License (CC BY 3.0): http://creativecommons.org/licenses/by/3.0/legalcode
Attribution:
The Department of Arts and Culture of the government of the Republic of South Africa (DAC), Council for Scientific and… See the full description on the dataset page: https://huggingface.co/datasets/Max5ive/nchlt_speech_afrikaans.afrispeech_afrikaansenglish-afrikaans_sentence-pairs_mt560
English-Afrikaans Parallel Dataset
This dataset contains parallel sentences in English and Afrikaans (South Africa).
Dataset Information
Language Pair: English ↔ Afrikaans
Language Code: afr
Country: South Africa
Original Source: OPUS MT560 Dataset
Dataset Structure
The dataset contains parallel sentences that can be used for:
Machine translation training
Cross-lingual NLP tasks
Language model fine-tuning
Citation
If you use this dataset, please… See the full description on the dataset page: https://huggingface.co/datasets/michsethowusu/english-afrikaans_sentence-pairs_mt560.Lexique_Afrikaans
[!NOTE]
Dataset origin: https://upload.wikimedia.org/wikipedia/commons/8/83/Lexique_Afrikaans.pdf
afrikaans-dinka_sentence-pairs
Afrikaans-Dinka_Sentence-Pairs Dataset
This dataset contains sentence pairs for African languages along with similarity scores. It can be used for machine translation, sentence alignment, or other natural language processing tasks.
This dataset is based on the NLLBv1 dataset, published on OPUS under an open-source initiative led by META. You can find more information here: OPUS - NLLB-v1
Metadata
File Name: Afrikaans-Dinka_Sentence-Pairs
Number of Rows: 113795
Number… See the full description on the dataset page: https://huggingface.co/datasets/michsethowusu/afrikaans-dinka_sentence-pairs.Afrikaans_testafrikaans-sentiments-corpus
Afrikaans Sentiment Corpus
Dataset Description
This dataset contains sentiment-labeled text data in Afrikaans for binary sentiment classification (Positive/Negative). Sentiments are extracted and processed from the English meanings of the sentences using DistilBERT for sentiment classification. The dataset is part of a larger collection of African language sentiment analysis resources.
Dataset Statistics
Total samples: 1,500,000
Positive sentiment: 803944… See the full description on the dataset page: https://huggingface.co/datasets/michsethowusu/afrikaans-sentiments-corpus.alpaca-afrikaans-cleanedThis repository contains the dataset used for the TaCo paper.
Please refer to the paper for more details: OpenReview
If you have used our dataset, please cite it as follows:
Citation
@inproceedings{upadhayay2024taco,
title={TaCo: Enhancing Cross-Lingual Transfer for Low-Resource Languages in {LLM}s through Translation-Assisted Chain-of-Thought Processes},
author={Bibek Upadhayay and Vahid Behzadan},
booktitle={5th Workshop on practical ML for limited/low resource settings, ICLR},
year={2024}… See the full description on the dataset page: https://huggingface.co/datasets/saillab/alpaca-afrikaans-cleaned.Roleplay-Afrikaans
RolePlay-Afrikaans
Roleplay-Afrikaans Dataset is a dataset for roleplaying in the Afrikaans language for Large Language Model.
The base dataset is GPTeacher role play dataset by teknium 1, which can be found under this link, released under MIT License. The dataset is then translated into respective languages. The translation process is powered by Google Translate, using cloud translation API.
For more information and other language datasets for roleplay, it can be found at this… See the full description on the dataset page: https://huggingface.co/datasets/jojo-ai-mst/Roleplay-Afrikaans.afrikaans-tswana_sentence-pairs
Afrikaans-Tswana_Sentence-Pairs Dataset
This dataset contains sentence pairs for African languages along with similarity scores. It can be used for machine translation, sentence alignment, or other natural language processing tasks.
This dataset is based on the NLLBv1 dataset, published on OPUS under an open-source initiative led by META. You can find more information here: OPUS - NLLB-v1
Metadata
File Name: Afrikaans-Tswana_Sentence-Pairs
Number of Rows: 779259… See the full description on the dataset page: https://huggingface.co/datasets/michsethowusu/afrikaans-tswana_sentence-pairs.MATH-500-afrikaansCode-170k-afrikaans
Dataset Description
Code-170k-afrikaans is a groundbreaking dataset containing 176,999 programming conversations, originally sourced from glaiveai/glaive-code-assistant-v2 and translated into Afrikaans, making coding education accessible to Afrikaans speakers.
🌟 Key Features
176,999 high-quality conversations about programming and coding
Pure Afrikaans language - democratizing coding education
Multi-turn dialogues covering various programming concepts
Diverse topics:… See the full description on the dataset page: https://huggingface.co/datasets/michsethowusu/Code-170k-afrikaans.afrikaans-wolof_sentence-pairs
Afrikaans-Wolof_Sentence-Pairs Dataset
This dataset contains sentence pairs for African languages along with similarity scores. It can be used for machine translation, sentence alignment, or other natural language processing tasks.
This dataset is based on the NLLBv1 dataset, published on OPUS under an open-source initiative led by META. You can find more information here: OPUS - NLLB-v1
Metadata
File Name: Afrikaans-Wolof_Sentence-Pairs
Number of Rows: 237049
Number… See the full description on the dataset page: https://huggingface.co/datasets/michsethowusu/afrikaans-wolof_sentence-pairs.afrikaans-somali_sentence-pairs
Afrikaans-Somali_Sentence-Pairs Dataset
This dataset contains sentence pairs for African languages along with similarity scores. It can be used for machine translation, sentence alignment, or other natural language processing tasks.
This dataset is based on the NLLBv1 dataset, published on OPUS under an open-source initiative led by META. You can find more information here: OPUS - NLLB-v1
Metadata
File Name: Afrikaans-Somali_Sentence-Pairs
Number of Rows: 1432536… See the full description on the dataset page: https://huggingface.co/datasets/michsethowusu/afrikaans-somali_sentence-pairs.afrikaans-tigrinya_sentence-pairs
Afrikaans-Tigrinya_Sentence-Pairs Dataset
This dataset contains sentence pairs for African languages along with similarity scores. It can be used for machine translation, sentence alignment, or other natural language processing tasks.
This dataset is based on the NLLBv1 dataset, published on OPUS under an open-source initiative led by META. You can find more information here: OPUS - NLLB-v1
Metadata
File Name: Afrikaans-Tigrinya_Sentence-Pairs
Number of Rows: 454333… See the full description on the dataset page: https://huggingface.co/datasets/michsethowusu/afrikaans-tigrinya_sentence-pairs.afrikaans-ganda_sentence-pairs
Afrikaans-Ganda_Sentence-Pairs Dataset
This dataset contains sentence pairs for African languages along with similarity scores. It can be used for machine translation, sentence alignment, or other natural language processing tasks.
This dataset is based on the NLLBv1 dataset, published on OPUS under an open-source initiative led by META. You can find more information here: OPUS - NLLB-v1
Metadata
File Name: Afrikaans-Ganda_Sentence-Pairs
Number of Rows: 477046
Number… See the full description on the dataset page: https://huggingface.co/datasets/michsethowusu/afrikaans-ganda_sentence-pairs.afrikaans-fulah_sentence-pairs
Afrikaans-Fulah_Sentence-Pairs Dataset
This dataset contains sentence pairs for African languages along with similarity scores. It can be used for machine translation, sentence alignment, or other natural language processing tasks.
This dataset is based on the NLLBv1 dataset, published on OPUS under an open-source initiative led by META. You can find more information here: OPUS - NLLB-v1
Metadata
File Name: Afrikaans-Fulah_Sentence-Pairs
Number of Rows: 168995
Number… See the full description on the dataset page: https://huggingface.co/datasets/michsethowusu/afrikaans-fulah_sentence-pairs.afrikaans-bambara_sentence-pairs
Afrikaans-Bambara_Sentence-Pairs Dataset
This dataset contains sentence pairs for African languages along with similarity scores. It can be used for machine translation, sentence alignment, or other natural language processing tasks.
This dataset is based on the NLLBv1 dataset, published on OPUS under an open-source initiative led by META. You can find more information here: OPUS - NLLB-v1
Metadata
File Name: Afrikaans-Bambara_Sentence-Pairs
Number of Rows: 121709… See the full description on the dataset page: https://huggingface.co/datasets/michsethowusu/afrikaans-bambara_sentence-pairs.Glossaries_Sample_Afrikaans_SMCafrikaans-kamba_sentence-pairs
Afrikaans-Kamba_Sentence-Pairs Dataset
This dataset contains sentence pairs for African languages along with similarity scores. It can be used for machine translation, sentence alignment, or other natural language processing tasks.
This dataset is based on the NLLBv1 dataset, published on OPUS under an open-source initiative led by META. You can find more information here: OPUS - NLLB-v1
Metadata
File Name: Afrikaans-Kamba_Sentence-Pairs
Number of Rows: 99196
Number… See the full description on the dataset page: https://huggingface.co/datasets/michsethowusu/afrikaans-kamba_sentence-pairs.alpacaeval-afrikaansspeech_accent_5_afrikaans