datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
musan
MUSAN: A Music, Speech, and Noise Corpus
MUSAN is a corpus of music, speech, and noise recordings designed for training models for voice activity detection and music/speech discrimination. This is a comprehensive collection suitable for various audio processing tasks.
Dataset Structure
The dataset is organized into three main categories:
1. Music (~42 hours)
Subcategories: Classical, Pop/Rock, Jazz, and more
Sources: Free Music Archive, Jamendo, and others… See the full description on the dataset page: https://huggingface.co/datasets/FluidInference/musan.fluent_speech_commands_synth
Dataset Card for "fluent_speech_commands_synth"
More Information needed
fleurs-full
FLEURS Full - Test Set for ASR Benchmarking
Complete test set of Google FLEURS for all 30 languages supported by Qwen3-ASR, prepared for benchmarking with FluidAudio.
Languages (30)
Asian Languages (13)
Code
Language
Samples
cmn_hans_cn
Chinese (Mandarin)
945
yue_hant_hk
Cantonese
819
ja_jp
Japanese
650
ko_kr
Korean
382
vi_vn
Vietnamese
857
th_th
Thai
1,021
id_id
Indonesian
687
ms_my
Malay
749
hi_in
Hindi
418
ar_eg
Arabic (Egyptian)… See the full description on the dataset page: https://huggingface.co/datasets/FluidInference/fleurs-full.THCHS-30-tests
THCHS-30 Test Set
THCHS-30 test split for Mandarin Chinese speech recognition benchmarking.
Dataset Info
Language: Mandarin Chinese (zh-CN)
Samples: 2,495
Speakers: 10
Sample Rate: 16 kHz
License: Apache 2.0
Usage
from datasets import load_dataset
# After uploading to HuggingFace
dataset = load_dataset("your-username/thchs30-test")
# Example
print(dataset['train'][0])
# {
# 'audio': {'array': [...], 'sampling_rate': 16000, 'path': 'audio/D11_750.wav'},
#… See the full description on the dataset page: https://huggingface.co/datasets/FluidInference/THCHS-30-tests.ami-corpus-mirror
AMI Corpus Mirror
Mirror of the subset of the AMI Meeting Corpus used by
FluidAudio diarization benchmarks. Hosted here so CI and
local benchmark runs do not depend on the availability of the upstream groups.inf.ed.ac.uk server
(see FluidAudio#752).
Contents
annotations/ami_public_manual_1.6.2.zip — AMI public manual annotations v1.6.2
(repackaged from the official archive; identical content, including segments/, words/,
corpusResources/meetings.xml)… See the full description on the dataset page: https://huggingface.co/datasets/FluidInference/ami-corpus-mirror.BibleMMSThe Dataset associated with the Paper "Meta Learning Text-to-Speech Synthesis in over 7000 Languages" by Florian Lux, Sarina Meyer, Lyonel Behringer, Frank Zalkow, Phat Do, Matt Coler, Emanuël A. P. Habets and Ngoc Thang Vu (Interspeech 2024).
We generate 2000 spoken utterances per language using the subsets of the eBible dataset [1] that are under free licenses as the text input to the MMS TTS models [2].
The languages associated with the following ISO-639-3 codes are represented in this… See the full description on the dataset page: https://huggingface.co/datasets/Flux9665/BibleMMS.fluent_speech_commands_femaleJSUT-basic5000
JSUT (Japanese Speech Corpus) - Test Subset
A test subset of the JSUT corpus containing 500 Japanese utterances from the basic5000 dataset (BASIC5000_4501-5000).
Dataset Structure
jsut_ver1.1/
└── basic5000/
├── wav/ # WAV audio files (500 files, 48kHz)
├── transcript_utf8.txt # Transcriptions
└── recording_info.txt # Recording dates
File Formats
transcript_utf8.txt
BASIC5000_4501:だが、エーアイセンター稼動を快く思わない...… See the full description on the dataset page: https://huggingface.co/datasets/FluidInference/JSUT-basic5000.fluent_speech_commands_malelibrispeechfleurs
FLEURS Test Dataset
Reorganized FLEURS test dataset with audio and transcripts together.
Structure
fleurs-test/
├── en_us/
│ ├── en_us_0000.wav
│ ├── en_us_0001.wav
│ ├── ...
│ ├── en_us.trans.txt (LibriSpeech format)
│ ├── en_us.csv (detailed metadata)
│ └── en_us.json (JSON metadata)
├── fr_fr/
│ └── ...
└── ...
Languages
bg_bg: 350 test samples
cs_cz: 350 test samples
da_dk: 930 test samples
de_de: 350 test samples
el_gr: 650… See the full description on the dataset page: https://huggingface.co/datasets/FluidInference/fleurs.flusense
FluSense
FluSense is a dataset of segmented audio events derived from the FluSense platform, a contactless influenza-like illness surveillance system.
This dataset is intended for use in flu symptom detection.
Dataset Structure
Each sample includes:
audio: audio segment (waveform and sampling rate)
label: string label (e.g., "cough", "speech", etc.)
Labels
The dataset includes the following sound event classes:
cough
sneeze
sniffle
speech
silence… See the full description on the dataset page: https://huggingface.co/datasets/vtsouval/flusense.tooltalk-samples
ToolTalk Samples - High Quality Duplex Speech and Tool-calling in Customer Service Domain
Two people improvise realistic customer-service calls while one operates a live, stateful tool environment—with synchronized speaker-separated audio, tool calls, and outcomes.
▶ Listen to Clean · ▶ Listen to Noisy · Discuss the full dataset
In this sample: 26 calls · 90.7 minutes · 7 sample domains · 207 tool calls
Technical specs: 48 kHz / 32-bit PCM speaker-separated source… See the full description on the dataset page: https://huggingface.co/datasets/fluid-concepts/tooltalk-samples.fluent_speech_commands_test_subset_synth
Dataset Card for "fluent_speech_commands_test_subset_synth"
More Information needed
cv-corpus-25.0-ja
Mozilla Common Voice 25.0 - Japanese Test Set (Complete)
Dataset Description
Complete Japanese test set from Mozilla Common Voice Corpus 25.0. This dataset contains all 9,019 validated test samples, compared to the partial 2,334-sample version previously available on HuggingFace.
Key Features
Size: 9,019 validated test utterances
Coverage: 100% of official Common Voice 25.0 Japanese test split
Multi-speaker: Diverse set of speakers with demographic metadata… See the full description on the dataset page: https://huggingface.co/datasets/FluidInference/cv-corpus-25.0-ja.multimodal-peer-collaboration-samples
Multimodal Peer Collaboration Samples - Embodied Map Task with Two Camera Angles
Two non-experts collaborate to build working circuits under asymmetric information: the instructor has the manual, the student has the components, and synchronized audio and dual-camera video capture how shared understanding emerges.
▶ Watch the interactions · See Expert Instruction samples · Discuss the full collection
Sister collection: Expert Instruction, a teacher and a student in… See the full description on the dataset page: https://huggingface.co/datasets/fluid-concepts/multimodal-peer-collaboration-samples.friend-bench
Can a model — or a human — tell how two people are related from a 20-second clip of how they interact?
🌐 Built on Seamless Interaction
FriendBench is a suite of benchmarks for social perception from thin-slice dyadic
interaction — inferring facts about two people's relationship from a brief clip of how they
interact, built on the Seamless Interaction
dataset. Each released set is a config of this repository.
🎧 Multi-modal — text, audio, and video for every clip
🎯 Objective label —… See the full description on the dataset page: https://huggingface.co/datasets/fluid-concepts/friend-bench.multimodal-expert-instruction-samples
Multimodal Expert Instruction Samples - Musical Instrument Lessons with Channel-separated Audio and Video
A music teacher and a student work through two one-on-one lessons: both voices and both instruments on separate tracks, the student on camera, with the lesson plans, the instructions given to each side and both sides' post-lesson ratings alongside.
▶ Watch the lessons · See Peer Collaboration samples · Discuss the full collection
Sister collection: Peer Collaboration… See the full description on the dataset page: https://huggingface.co/datasets/fluid-concepts/multimodal-expert-instruction-samples.CodecDeepfakeDetectionIn this spoof detection dataset, the bonafide speech is resynthesized using various popular neural audio codecs, which are used for compression and low-bandwidth transmission of speech signals. The spoofed speech samples we provide are generated with a selection of popular and well performing language model based speech synthesis methods, which utilize the same codecs as the bonafide audios to obtain discretized speech tokens. This takes the artifacts of the codecs out of the equation and lets… See the full description on the dataset page: https://huggingface.co/datasets/Flux9665/CodecDeepfakeDetection.cv-ru-test-speaker
Benchmark for Speaker Similarity Evaluation in VC Systems for the Russian Language.
Benchmark for speaker similarity evaluation based on the Common Voice dataset.
Dataset summary
The dataset is based on the development (dev) portion of the Russian subset from the Common Voice dataset v18.0. The data are filtered according to the following conditions:
Files with a duration of less than 2 seconds are discarded.
Files that are empty after applying VAD… See the full description on the dataset page: https://huggingface.co/datasets/FluentaAI/cv-ru-test-speaker.aec-challenge-synthetic-mini
AEC-Challenge synthetic mini (200 examples)
First 200 examples (shard 0, dataset order) of the Microsoft AEC-Challenge
synthetic set (https://github.com/microsoft/AEC-Challenge/tree/main/datasets/synthetic,
Sridhar et al., ICASSP 2021, arXiv:2009.04972), exported from the
PandaLT/microsoft-AEC-dataset parquet mirror as 16 kHz 16-bit mono WAV:
fileid_<id>_mic.wav near-end microphone signal (near-end speech + echo, optionally noise)
fileid_<id>_lpb.wav far-end / loopback… See the full description on the dataset page: https://huggingface.co/datasets/FluidInference/aec-challenge-synthetic-mini.sep28k-fluencybank-stutter-datasetf1-team-radio
F1 Team Radio Dataset
A comprehensive dataset of Formula 1 team radio communications with transcriptions.
Dataset Description
This dataset contains team radio audio clips from Formula 1 races along with their text transcriptions. Team radio communications are the real-time messages exchanged between F1 drivers and their pit wall engineers during race weekends.
Dataset Statistics
Metric
Value
Total audio clips
14,681
Grand Prix events
149
Unique… See the full description on the dataset page: https://huggingface.co/datasets/fluffypotatoes/f1-team-radio.FluxMusicText-Music dataset
license: apache-2.0
cv20_and_fluer_mnspeechocean762_fluencyfluent_noisyL2EnglishScoring_speechocean762_fluency_v2L2EnglishScoring_speechocean762_fluencyfluent_slu_v1.0
Dataset Card for "fluent_slu_v1.0"
More Information needed