covost2
Datasets
All datasets matching “covost2”covost2This is a partial copy of CoVoST2 dataset.
The main difference is that the audio data is included in the dataset, which makes usage easier and allows browsing the samples using HF Dataset Viewer.
The limitation of this method is that all audio samples of the EN_XX subsets are duplicated, as such the size of the dataset is larger.
As such, not all the data is included: Only the validation and test subsets are available.
From the XX_EN subsets, only fr, es, and zh-CN are included.
covost2_en-zhcovost2CoVoST 2, a large-scale multilingual speech translation corpus covering translations from 21 languages into English and from English into 15 languages. The dataset is created using Mozilla’s open source Common Voice database of crowdsourced voice recordings.
Note that in order to limit the required storage for preparing this dataset, the audio
is stored in the .mp3 format and is not converted to a float32 array. To convert, the audio
file to a float32 array, please make use of the `.map()` function as follows:
```python
import torchaudio
def map_to_array(batch):
speech_array, _ = torchaudio.load(batch["file"])
batch["speech"] = speech_array.numpy()
return batch
dataset = dataset.map(map_to_array, remove_columns=["file"])
```CoVoST2-EN-AR
Dataset Description
CoVoST 2 is a large-scale multilingual speech translation corpus based on Common Voice, developed by FAIR. This is the English-to-Arabic portion of the dataset. The original dataset can be found here.
Data Splits (EN-AR)
lang
train
validation
test
EN-AR
289430
15531
15531
AR-EN
2283
1758
1695
Citation
@misc{wang2020covost,
title={CoVoST 2: A Massively Multilingual Speech-to-Text Translation Corpus},
author={Changhan… See the full description on the dataset page: https://huggingface.co/datasets/ymoslem/CoVoST2-EN-AR.covost2_synth
Dataset Card for "covost2_synth"
More Information needed
covost2_extract_unit
Dataset Card for "covost2_extract_unit"
More Information needed