Datasetpublic

WhissleAI/Meta_STT_SLAVIC_CommonVoice

Meta Speech Recognition Slavic Languages Dataset (Common Voice) This dataset contains metadata for Slavic language speech recognition samples from Common Voice. Dataset Sources and Credits This dataset contains samples from Mozilla Common Voice: Source: https://commonvoice.mozilla.org/en/datasets License: CC0-1.0 Citation: Please acknowledge Mozilla Common Voice if you use this data Languages Included The dataset includes the following Slavic… See the full description on the dataset page: https://huggingface.co/datasets/WhissleAI/Meta_STT_SLAVIC_CommonVoice.

sourceHugging Faceupdated 1y agoView on Hugging Face

0likes23downloads

Dataset Card

Meta Speech Recognition Slavic Languages Dataset (Common Voice)

This dataset contains metadata for Slavic language speech recognition samples from Common Voice.

Dataset Sources and Credits

This dataset contains samples from Mozilla Common Voice:

—Source: https://commonvoice.mozilla.org/en/datasets
—License: CC0-1.0
—Citation: Please acknowledge Mozilla Common Voice if you use this data

Languages Included

The dataset includes the following Slavic languages:

—Belarusian (be)
—Bulgarian (bg)
—Czech (cs)
—Georgian (ka)
—Macedonian (mk)
—Polish (pl)
—Russian (ru)
—Slovak (sk)
—Slovenian (sl)
—Serbian (sr)
—Ukrainian (uk)

Dataset Statistics

Splits and Sample Counts

—train: 1562732 samples
—valid: 86814 samples
—test: 86827 samples

Example Samples

train

json

{
  "audio_filepath": "/cv/cv-corpus-15.0-2023-09-08/be/clips/common_voice_be_35310612.mp3",
  "text": "Аднак электарат вырашыў інакш. AGE_18_30 GER_MALE EMOTION_NEUTRAL INTENT_INFORM",
  "duration": 5.22
}

json

{
  "audio_filepath": "/cv/cv-corpus-15.0-2023-09-08/be/clips/common_voice_be_32521083.mp3",
  "text": "Але гэта не адзіны паток. AGE_18_30 GER_FEMALE EMOTION_NEUTRAL INTENT_INFORM",
  "duration": 2.74
}

valid

json

{
  "audio_filepath": "/cv/cv-corpus-15.0-2023-09-08/be/clips/common_voice_be_29218733.mp3",
  "text": "Вы ж зразумейце наколькі гэта складана. AGE_18_30 GER_MALE EMOTION_NEUTRAL INTENT_INFORM",
  "duration": 4.32
}

json

{
  "audio_filepath": "/cv/cv-corpus-15.0-2023-09-08/be/clips/common_voice_be_29003430.mp3",
  "text": "Адмовіцца ад яго немагчыма. AGE_18_30 GER_MALE EMOTION_NEUTRAL INTENT_ASSERT",
  "duration": 3.42
}

test

json

{
  "audio_filepath": "/cv/cv-corpus-15.0-2023-09-08/be/clips/common_voice_be_29742537.mp3",
  "text": "Гарэла святло ў хатах. AGE_18_30 GER_FEMALE EMOTION_FEAR INTENT_INFORM",
  "duration": 2.45
}

json

{
  "audio_filepath": "/cv/cv-corpus-15.0-2023-09-08/be/clips/common_voice_be_28447241.mp3",
  "text": "А новых грошай узяць няма адкуль. AGE_18_30 GER_MALE EMOTION_NEUTRAL INTENT_INFORM",
  "duration": 3.31
}

Downloading Audio Files

To use this dataset, you need to download the Common Voice dataset for each language. The audio files are not included in this repository.

Download Instructions

1.Download Common Voice dataset version 15.0 (2023-09-08) for each language:

bash

# For each language (replace {lang} with language code: be, bg, cs, ka, mk, pl, ru, sk, sl, sr, uk)
wget https://voice-prod-bundler-ee1969a6ce8178826482b88e843c335139bd3fb4.s3.amazonaws.com/cv-corpus-15.0-2023-09-08/{lang}.tar.gz

# Extract the files
tar -xzf {lang}.tar.gz

1.Place the extracted files in the following structure:

/cv/cv-corpus-15.0-2023-09-08/
├── be/
├── bg/
├── cs/
├── ka/
├── mk/
├── pl/
├── ru/
├── sk/
├── sl/
├── sr/
└── uk/