datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
cv22-neucodec
Dataset Statistics
The following table summarizes the number of examples for each config_name, the corresponding language, and each split.
config_name
language
train_examples
validation_examples
test_examples
other_examples
af
Afrikaans
139
125
131
306
am
Amharic
523
248
252
579
ar
Arabic
28,531
10,503
10,500
41,364
as
Assamese
952
485
379
2,557
az
Azerbaijani
157
78
95
529
be
Belarusian
347,672
15,879
15,880
17,002
bg
Bulgarian
4,952
2,932
3,354
1,787
bn… See the full description on the dataset page: https://huggingface.co/datasets/deepdml/cv22-neucodec.fleurs-r-neucodec-all-languages
FLEURS-R NeuCodec All Languages
FLEURS-R metadata, source audio and precomputed NeuCodec speech tokens for 102
locales, plus a speaker label FLEURS itself does not ship.
Layout
data/{locale}-{split}.parquet — metadata, one row per utterance (this is what the
viewer shows).
audio/{locale}-{split}.zip — source FLEURS-R audio, 24kHz mono PCM16 WAV, members
named audio/{locale}/{split}/{id}.wav (the path column).
neucodec/{locale}-{split}-rank{N}.zip — NeuCodec… See the full description on the dataset page: https://huggingface.co/datasets/malaysia-ai/fleurs-r-neucodec-all-languages.fleurs-neucodec
Dataset
Dataset Statistics
This table shows the number of examples per language configuration and split.
config_name
train_examples
validation_examples
test_examples
af_za
1.032
198
264
am_et
3.163
223
516
ar_eg
2.104
295
428
as_in
2.812
418
984
ast_es
2.511
398
946
az_az
2.665
400923
be_by
2.433
408
967
bg_bg
2.973
395
658
bn_in
3.006
402
920
bs_ba
3.091
400
925
ca_es
2.300
404
940
ceb_ph
3.261
225
541
ckb_iq
3.040
386
922
cmn_hans_cn… See the full description on the dataset page: https://huggingface.co/datasets/deepdml/fleurs-neucodec.emilia-yodas-english-neucodec
Dataset Card for NeuCodec Emilia-YODAS
Dataset Summary
The NeuCodec Emilia-YODAS dataset is an English-language dataset containing >30M audio samples (>78k hours), taken from the English-language subset of Emilia-YODAS and compressed with NeuCodec.
Usage
import torch
from datasets import load_dataset
from neucodec import NeuCodec
# load dataset and model
dataset = load_dataset("neuphonic/emilia-yodas-english-neucodec", split="train"… See the full description on the dataset page: https://huggingface.co/datasets/neuphonic/emilia-yodas-english-neucodec.emilia-yodas-en-neucodeccv17-neucodec
Dataset
Dataset Overview
This dataset contains Common Voice speech data encoded into neural codec representations.
Each sample includes:
audio_path
duration
codes
sentence
language
client_id
The dataset is organized by language configuration and split into train, validation, and test sets when available.
Dataset Statistics
The following table summarizes the number of examples for each config_name and split.
Dataset Statistics
The following… See the full description on the dataset page: https://huggingface.co/datasets/deepdml/cv17-neucodec.yodas-granary-it-neucodec-10s-20s
Granary Italian VoxPopuli NeuCodec
NeuCodec-tokenized rows for NeuTTS fine-tuning. The source rows were streamed from espnet/yodas-granary / Italian and uploaded as resumable Parquet shards.
{
"source_dataset": "espnet/yodas-granary",
"source_config": "Italian",
"source_splits": [
"ast"
],
"validation_source_split": null,
"codec_checkpoint": "neuphonic/neucodec",
"columns": [
"text",
"codes",
"duration",
"source_dataset",
"source_config"… See the full description on the dataset page: https://huggingface.co/datasets/Steveeeeeeen/yodas-granary-it-neucodec-10s-20s.yodas-granary-it-neucodec-150k
Granary Italian VoxPopuli NeuCodec
NeuCodec-tokenized rows for NeuTTS fine-tuning. The source rows were streamed from espnet/yodas-granary / Italian and uploaded as resumable Parquet shards.
{
"source_dataset": "espnet/yodas-granary",
"source_config": "Italian",
"source_splits": [
"ast"
],
"validation_source_split": null,
"codec_checkpoint": "neuphonic/neucodec",
"columns": [
"text",
"codes",
"duration",
"source_dataset",
"source_config"… See the full description on the dataset page: https://huggingface.co/datasets/Steveeeeeeen/yodas-granary-it-neucodec-150k.yodas-granary-it-neucodec-300k-5s30s
Granary Italian VoxPopuli NeuCodec
NeuCodec-tokenized rows for NeuTTS fine-tuning. The source rows were streamed from espnet/yodas-granary / Italian and uploaded as resumable Parquet shards.
{
"source_dataset": "espnet/yodas-granary",
"source_config": "Italian",
"source_splits": [
"ast",
"asr"
],
"validation_source_split": null,
"codec_checkpoint": "neuphonic/neucodec",
"columns": [
"text",
"codes",
"duration",
"source_dataset"… See the full description on the dataset page: https://huggingface.co/datasets/Steveeeeeeen/yodas-granary-it-neucodec-300k-5s30s.emovoice-neucodeccommon_voice_17-pl-speakers-v2.0-neucodecasante-twi-neucodec-encodedcommon-voice-urdu-male-neucodecneucodec_slr_sustemilia-yodas-english-neucodec-VJKL-250kemilia-yodas-english-neucodec-VJKL-250k-prepfluers-token-neucodecagri-male-16kHz-neucodecnEMO-speakers-v2.0-neucodecfleurs-pl-v1.0-neucodecUrduTTSDataset-16khz-neucodecmaya-distill-data-neucodecwaxal-lug-neucodecplt-neucodecEmoDB-neucodecgranary-it-voxpopuli-neucodec
Granary Italian VoxPopuli NeuCodec
NeuCodec-tokenized rows for NeuTTS fine-tuning. The source rows were streamed from nvidia/Granary / it_voxpopuli and uploaded as resumable Parquet shards.
{
"source_dataset": "nvidia/Granary",
"source_config": "it_voxpopuli",
"source_split": "asr",
"validation_source_split": "asr",
"codec_checkpoint": "neuphonic/neucodec",
"columns": [
"text",
"codes",
"duration",
"source_dataset",
"source_config",
"source_split"… See the full description on the dataset page: https://huggingface.co/datasets/Steveeeeeeen/granary-it-voxpopuli-neucodec.nnh-neucodecplt-clone-neucodecemilia-yodas-english-neucodec-VFLTYemilia-yodas-english-neucodec-VJKL-25k-prep