datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
VaaniVAANI is an India-representative multi-modal multi-lingual dataset.
The current version (phase 1- 80 districts, phase 2- 85 districts) contains ~31278 hours of spontaenous,image-prompted speech by 156K speakers across 165 districts, talking about 288K images covering 105 languages.
From this audio data, 2,122 hours of transcribed data(text) is available, spanning almost evenly across the 165 districts.
Project Vaani, by IISc, Bangalore and ARTPARK, is capturing the true diversity of India’s… See the full description on the dataset page: https://huggingface.co/datasets/ARTPARK-IISc/Vaani.Vaani-transcription-partThis dataset is part of the Vaani dataset and consists of only transcribed speech data. It has a total duration of 2041.54 hours, covering 59 languages.
This table represents the audio and transcription duration data for various languages.
Language
Angami
Angika
Ao
Assamese
Awadhi
Bajjika
Bearybashe
Bengali
Bhili
Bhojpuri
Bundeli
Chakhesang
Chakma
Chhattisgarhi
English
Garhwali
Garo
Gondi
Gujarati
Halbi
Haryanvi
Hindi
IduMishmi
Kannada
Kashmiri
Karbi
Khariboli
Khortha
Kokborok
Konkani… See the full description on the dataset page: https://huggingface.co/datasets/ARTPARK-IISc/Vaani-transcription-part.Vaani-Benchmark-V1.0
Vaani-Benchmark-V1.0
A curated ASR evaluation set drawn from the Vaani project. This benchmark contains 5,050 audio segments from 1,103 speakers across 104 Indian districts, each with three independent human transcriptions.
Evaluation Toolkit
A standalone toolkit implementing this benchmark's scoring methodology, plus
Latin-script normalization for code-switched predictions and one-command
publishing of results to a model's HF card, is available at… See the full description on the dataset page: https://huggingface.co/datasets/ARTPARK-IISc/Vaani-Benchmark-V1.0.golos_mfa_punctuation_long
Golos MFA Punctuation (Long)
Long-form Russian speech derived from
govnejri/golos_mfa_punctuation.
Purpose
Most public Russian STT corpora ship as short clips (a few seconds each).
For benchmarking long-form transcription, VAD, punctuation, and streaming
behavior, you want minutes-long audio with reliable word-level alignments.
This dataset builds those long clips by splicing groups of consecutive
short clips together, inserting randomized silences between them, and… See the full description on the dataset page: https://huggingface.co/datasets/artmelancholy/golos_mfa_punctuation_long.Vaani-Atypical-Speech-CorpusProject Euphonia is a public initiative led by Google that aims to improve Automatic Speech Recognition (ASR) for individuals with atypical speech. To date, most of Project Euphonia’s work has focused on English, resulting in outcomes such as the Android application Project Relate, which generates personalized speech recognition models in English.
In recent years, the project has expanded its data collection efforts to additional languages, including French, Spanish, Japanese, and Hindi.
The… See the full description on the dataset page: https://huggingface.co/datasets/ARTPARK-IISc/Vaani-Atypical-Speech-Corpus.