mosama/sada-validation-preprocessed
Details This is the SADA 2022 dataset with the input_features whish are log mels and the cleaned_labels which is the tokenized version of the cleaned_text. You can directly use this as the validation dataset when training Whisper Tiny, Small, Base & Medium models, as they all use the same tokenizer. Please double check this as well from the original model repo. In addtition, the following filters were applied to this data: All audios are less than 30 seconds and greater than 0… See the full description on the dataset page: https://huggingface.co/datasets/mosama/sada-validation-preprocessed.
Details
This is the SADA 2022 dataset with the inputfeatures whish are log mels and the cleanedlabels which is the tokenized version of the cleaned_text. You can directly use this as the validation dataset when training Whisper Tiny, Small, Base & Medium models, as they all use the same tokenizer. Please double check this as well from the original model repo.
In addtition, the following filters were applied to this data:
- All audios are less than 30 seconds and greater than 0 seconds.
- All cleaned_text have token lengths less than 448 and greater than 0.
- All rows with 'nan' in cleanedtext or cleanedtext only having whitespace or being empty were dropped.