datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
librispeech_asr
Dataset Card for librispeech_asr
Dataset Summary
LibriSpeech is a corpus of approximately 1000 hours of 16kHz read English speech, prepared by Vassil Panayotov with the assistance of Daniel Povey. The data is derived from read audiobooks from the LibriVox project, and has been carefully segmented and aligned.
Supported Tasks and Leaderboards
automatic-speech-recognition, audio-speaker-identification: The dataset can be used to train a model for Automatic… See the full description on the dataset page: https://huggingface.co/datasets/openslr/librispeech_asr.openslrOpenSLR is a site devoted to hosting speech and language resources, such as training corpora for speech recognition,
and software related to speech recognition. We intend to be a convenient place for anyone to put resources that
they have created, so that they can be downloaded publicly.openslr_quranic_asropenslr-140-hq-Kazakh
Kazakh Speech Dataset (KSD)
Identifier: SLR140
Source: https://www.openslr.org/140/
Summary: High-quality open source Kazakh speech corpus developed by the Department of Artificial Intelligence and Big Data of Al-Farabi Kazakh National University (554 hours)
Category: Speech
License: Attribution-ShareAlike 3.0 Unported (CC BY-SA 3.0 US)
About this resource:
High-quality open source Kazakh speech corpus.
The corpus contains about 554 hours of transcribed audio recordings… See the full description on the dataset page: https://huggingface.co/datasets/voice-biomarkers/openslr-140-hq-Kazakh.burmese-speech-refined-openslr-80
Burmese Speech Refined OpenSLR-80
Summary
This dataset is a speech dataset developed based on the original OpenSLR Dataset (SLR80), with the text and audio data carefully reviewed and further refined for Burmese language applications.
In the original OpenSLR Dataset, the Burmese text was transcribed based on how the words were pronounced in the corresponding audio recordings. In this dataset, the original audio and text data were used as a reference, and the text… See the full description on the dataset page: https://huggingface.co/datasets/thantzinphyo/burmese-speech-refined-openslr-80.sinhala-openslr-111hasr-khm-ddd-fleurs-openslr2openslr-sinhala-asr-normopenslr-sinhala-asrOpenSLR-126
Dataset Card for "OpenSLR-126"
More Information needed
librispeech_lmLanguage modeling resources to be used in conjunction with the LibriSpeech ASR corpus.openslr-sinhala-asr-depricated-versionopenslr-librispeech_asr-clean100-00000-19999-km-translateGujarati_OpenSLROpenSLR is a site devoted to hosting speech and language resources,
such as training corpora for speech recognition, and software related to speech recognition.
They intend to be a convenient place for anyone to put resources that they have created,
so that they can be downloaded publicly.
They aim to provide a central, hassle-free place for others to put their speech resources. see there http://www.openslr.org/contributions.html
#Supported Task
Automatic Speech Recognition
#Languages… See the full description on the dataset page: https://huggingface.co/datasets/Pratik/Gujarati_OpenSLR.myanmar-speech-dataset-openslr-80Please visit to the GitHub repository for other Myanmar Langauge datasets.
Myanmar Speech Dataset (OpenSLR-80)
This dataset consists exclusively of Myanmar speech recordings, extracted from the larger multilingual OpenSLR dataset.
For the complete multilingual dataset and additional information, please visit the original dataset repository
of OpenSLR HuggingFace page.
Original Source
OpenSLR is a site devoted to hosting speech and language resources, such as training… See the full description on the dataset page: https://huggingface.co/datasets/chuuhtetnaing/myanmar-speech-dataset-openslr-80.openslr65-tamil
OpenSLR-65 – Tamil Transcribed Speech
Source: https://www.openslr.org/65/
This dataset contains transcribed high-quality audio of Tamil sentences recorded
by volunteers. It is part of the OpenSLR collection of
free speech resources for low-resource languages.
The data was collected via the
Appen (formerly Figure Eight / CrowdFlower) crowdsourcing
platform and is intended for use in training automatic speech recognition (ASR)
and text-to-speech (TTS) systems.
Data… See the full description on the dataset page: https://huggingface.co/datasets/deepdml/openslr65-tamil.openslr-nepali-asr-cleanedThis data set contains transcribed audio data for Nepali. The data set consists of flac files, and a TSV file. The file utt_spk_text.tsv contains a FileID, anonymized UserID and the transcription of audio in the file.
The data set has been manually quality checked, but there might still be errors.
The audio files are sampled at rate of 16KHz, and leading and trailing silences are trimmed using torchaudio's voice activity detection.openslr-147-hq-Nahuatl
Veracruz Orizaba Nahuatl Endangered Language
Identifier: SLR147
Summary: Audio corpus of Orizaba (Veracruz) Nahuatl speech (Glottocode: oriz1235; ISO 639-3: nlv)
Category: Speech
License: Attribution-ShareAlike 3.0 Unported (CC BY-SA 3.0)
About this resource:
The substantive material of this deposit was gathered over a 13-month period from February 2022 to March 2023.
It comprised 657 files totaling approximately 119 hours, 26 minutes, 59 seconds of material. All but 81… See the full description on the dataset page: https://huggingface.co/datasets/voice-biomarkers/openslr-147-hq-Nahuatl.su-openslr
su-openslr (Sundanese ASR subset)
This dataset bundles Sundanese audio with a metadata.csv.
Files
audio/ — WAV files (su_id_female/, su_id_male/)
metadata.csv — columns like path, sentence, etc.
Usage
from datasets import load_dataset, Audio
ds = load_dataset("novalalthoff/su-openslr", data_files="metadata.csv", split="train")
ds = ds.cast_column("path", Audio(sampling_rate=16000))
openslr-sinhala-asr-preprocessedopenslr_asropenslr-32-hq-SA-languages-Afrikaans
High quality TTS data for four South African languages - Afrikaans
Source - https://openslr.org/32/
Identifier: SLR32
Summary: Multi-speaker TTS data for four South African languages - Afrikaans
License: Attribution-ShareAlike 4.0 International (CC BY-SA 4.0)
About this resource:
This data set contains multi-speaker high quality transcribed audio data for four languages of South Africa. The data set consists of wave files, and a TSV file transcribing the audio.… See the full description on the dataset page: https://huggingface.co/datasets/voice-biomarkers/openslr-32-hq-SA-languages-Afrikaans.openslr-slr69-ca-trimmed-denoised
Dataset Card for openslr-slr69-ca-denoised
This is a post-processed version of the Catalan subset belonging to the Open Speech and Language Resources (OpenSLR) speech dataset.
Specifically the subset OpenSLR-69.
The original HF🤗 SLR-69 dataset is located here.
Same license is maintained: Attribution-ShareAlike 4.0 International.
Dataset Details
Dataset Description
We processed the data of the Catalan OpenSLR with the following recipe:
Trimming: Long… See the full description on the dataset page: https://huggingface.co/datasets/projecte-aina/openslr-slr69-ca-trimmed-denoised.OpenSLR-79
Dataset Card for "OpenSLR-79"
More Information needed
fleurs-km-kh-openslr-SLR42
Combined openslr/openslr-SLR42 and google/fleurs-km-kh.
Each audio is shorter than or equal to 30 seconds.
Sampling rate is 16,000
Each transcription is already normalized by tha.normalize.processor (pip install tha)
openslr76
Dataset Card for "openslr76"
More Information needed
open_slr_lang_resourcefleurs_openslr42_mpwtNOTE: If your colab crashes, please use pip install --upgrade --quiet datasets[audio]==3.6.0 to install datasets[audio] version 3.6.0.
This dataset combined google/fleurs, openslr/openslr42, and cleaned seanghay/khmer_mpwt_speech.
Severals processes are executed:
clean up seanghay/khmer_mpwt_speech: manually correct wrong transcriptions over 2058 rows
normalize transcription: remove invisible white space; process ៗ, numbers, currencies, date into khmer text; and separate each word by space… See the full description on the dataset page: https://huggingface.co/datasets/KrorngAI/fleurs_openslr42_mpwt.OpenSLR54-Nepali-ASRopenslr42-khmer-male
OpenSLR SLR42 Khmer Male Speech
This dataset is a processed version of the OpenSLR SLR42 Khmer speech dataset.
Dataset Description
This dataset contains approximately 2,906 Khmer speech recordings with corresponding Khmer transcriptions.
Each example contains:
audio: Khmer speech recording
text: Khmer transcription
Dataset Structure
Column
Type
Description
audio
Audio
Khmer speech recording
text
String
Khmer transcription… See the full description on the dataset page: https://huggingface.co/datasets/phonsobon/openslr42-khmer-male.