Datasetpublic

mesolitica/CoVoST2-Instructions

CoVoST2 Instruction Originally from https://huggingface.co/datasets/facebook/covost2, we converted to speech instruction format. We also provide test split. We highly recommend to not include test set in training set to prevent contamination. Test set supposely to become a speech translation benchmark. how to prepare the dataset huggingface-cli download \ mesolitica/CoVoST2-Instructions \ --include "*.zip" \ --repo-type "dataset" \ --local-dir './' wget… See the full description on the dataset page: https://huggingface.co/datasets/mesolitica/CoVoST2-Instructions.

sourceHugging Faceupdated 1y agoView on Hugging Face

1likes142downloads

Dataset Card

CoVoST2 Instruction

Originally from https://huggingface.co/datasets/facebook/covost2, we converted to speech instruction format. We also provide test split.

We highly recommend to not include test set in training set to prevent contamination. Test set supposely to become a speech translation benchmark.

how to prepare the dataset

bash

huggingface-cli download \
mesolitica/CoVoST2-Instructions \
--include "*.zip" \
--repo-type "dataset" \
--local-dir './'

wget https://gist.githubusercontent.com/huseinzol05/2e26de4f3b29d99e993b349864ab6c10/raw/9b2251f3ff958770215d70c8d82d311f82791b78/unzip.py
python3 unzip.py

Acknowledgement

Special thanks to https://www.sns.com.my and Nvidia for 8x H100 node!