Datasetpublic

mesolitica/Speaker-Diarization-Instructions

Speaker-Diarization-Instructions Convert diarization dataset from https://huggingface.co/diarizers-community into speech instructions dataset and chunk max to 30 seconds because most of speech encoder use for LLM come from Whisper Encoder. We highly recommend to not include AMI test set from both AMI-IHM and AMI-SDM in training set to prevent contamination. This dataset supposely to become a speech diarization benchmark. how to prepare the dataset huggingface-cli… See the full description on the dataset page: https://huggingface.co/datasets/mesolitica/Speaker-Diarization-Instructions.

sourceHugging Faceupdated 1y agoView on Hugging Face

0likes104downloads

Dataset Card

Speaker-Diarization-Instructions

Convert diarization dataset from https://huggingface.co/diarizers-community into speech instructions dataset and chunk max to 30 seconds because most of speech encoder use for LLM come from Whisper Encoder.

We highly recommend to not include AMI test set from both AMI-IHM and AMI-SDM in training set to prevent contamination. This dataset supposely to become a speech diarization benchmark.

how to prepare the dataset

bash

huggingface-cli download \
mesolitica/Speaker-Diarization-Instructions \
--include "*.zip" \
--repo-type "dataset" \
--local-dir './'

unzip 0-0.zip

Acknowledgement

Special thanks to https://www.sns.com.my and Nvidia for 8x H100 node!