datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
open-asr-leaderboard-multilingual-datasets
ASR Leaderboard Datasets
This repository contains test splits from multiple speech corpora, including FLEURS, Common Voice (MCV), and Multilingual LibriSpeech (MLS).
How to Load
To load a specific subset, use load_dataset with the corresponding config_name in the format <set>_<lang>.
from datasets import load_dataset
# Load the FLEURS dataset for Bulgarian
fleurs_bg = load_dataset("nithinraok/asr-leaderboard-datasets", "fleurs_bg")
print(fleurs_bg)
# Load the… See the full description on the dataset page: https://huggingface.co/datasets/hf-audio/open-asr-leaderboard-multilingual-datasets.open-large-bengali-asr-data
Open Large Bengali ASR Data
This is a collection of publicly available ASR data for Bengali. It contains 5000 hours of audio. We have a filtering column called is_better to filter good-quality audio from the corpus. It is set based on the wer between original transcription and prediction taken from a Bengali-Wav2Vec2 model and word-per-second (wps).
Datasets:
commonvoice
openslr
madasr
shrutilipi
flerus
kathbath
indictts
ucla
gali
open-large-bengali-asr-data
Open Large Bengali ASR Data
This is a collection of publicly available ASR data for Bengali. It contains 5000 hours of audio. We have a filtering column called is_better to filter good-quality audio from the corpus. It is set based on the wer between original transcription and prediction taken from a Bengali-Wav2Vec2 model and word-per-second (wps).
Datasets:
commonvoice
Kirundi_Open_Speech_Dataset
🇧🇮 Kirundi Open Speech & Text Dataset
Building the first large-scale, open-source speech and text dataset for Kirundi
🚀 Get Started • 📊 Dataset • 🎯 Roadmap • 🫱🏿🫲🏾 Community
🌍 About This Project
Kirundi is spoken by over 12 million people, yet it remains a low-resource language largely ignored by modern AI systems. We're changing that.
This community-driven initiative aims to create the first comprehensive, open-source speech and text dataset for… See the full description on the dataset page: https://huggingface.co/datasets/Ijwi-ry-Ikirundi-AI/Kirundi_Open_Speech_Dataset.open-source-ai-models-dataset
OpenModelMap — The Largest Open-Source AI Models Dataset (Chinese + English)
2,484 models · 35 fields · 9 sources · Updated daily
This dataset provides the most comprehensive structured metadata for open-source AI models, with a focus on Chinese model coverage. Every model includes benchmark scores, hardware requirements, GPU compatibility, license information, and deployment methods.
What's Inside
Field
Description
id
HuggingFace model ID
name… See the full description on the dataset page: https://huggingface.co/datasets/duola15/open-source-ai-models-dataset.datasetsAll eight of datasets in ESB can be downloaded and prepared in just a single line of code through the Hugging Face Datasets library:
from datasets import load_dataset
librispeech = load_dataset("esb/datasets", "librispeech", split="train")
"esb/datasets": the repository namespace. This is fixed for all ESB datasets.
"librispeech": the dataset name. This can be changed to any of any one of the eight datasets in ESB to download that dataset.
split="train": the split. Set this to one of… See the full description on the dataset page: https://huggingface.co/datasets/open-asr-leaderboard/datasets.open-asr-leaderboard-multilingual-datasets
Open ASR Leaderboard Armenian Test Datasets
This private repository holds leaderboard-compatible Armenian test
configurations while their integration is being validated.
Configurations
fleurs_hy
Source: google/fleurs,
configuration hy_am, test split
Reviewed reference changes:
Metric-AI/fleurs-corrections,
test split
932 recordings; all 314 reviewed corrections were matched to the original
source transcript and applied
mcv_hy… See the full description on the dataset page: https://huggingface.co/datasets/Metric-AI/open-asr-leaderboard-multilingual-datasets.