WatsonNT/japanese-anime-speech-v2

Japanese Anime Speech Dataset V2

**日本語はこちら**

japanese-anime-speech-v2 is an audio-text dataset designed for training automatic speech recognition models. The dataset comprises 292,637 audio clips and their corresponding transcriptions from various visual novels. This dataset is <b>not</b> an updated version of <a href="https://huggingface.co/datasets/joujiboi/japanese-anime-speech-v1">japanese-anime-speech-v1</a>. For that reason, most of the audio from japanese-anime-speech-v1 is not included in this dataset.

The goal of this dataset is to increase the accuracy of automatic speech recognition models, such as OpenAI's Whisper, in accurately transcribing dialogue from anime and other similar Japanese media. This genre is characterized by unique vocal and linguistic features and speech patterns that diverge from conventional Japanese speech.

Dataset last updated on July 23rd 2024.

<div class="course-tip course-tip-orange bg-gradient-to-br dark:bg-gradient-to-r before:border-orange-500 dark:before:border-orange-800 from-orange-50 dark:from-gray-900 to-white dark:to-gray-950 border border-orange-50 text-orange-700 dark:text-gray-400"> <p> <b>Content Warning:</b> Please be advised that the audio in this dataset is sourced from visual novels and contains content that is not suitable for all audiences. <br> An effort was made to split sfw and nsfw content. However, this was purely based on defined rules that won't be 100% reliable. </p> </div>

A list of all audio files and transcriptions can be found **here** 📓

Information on dataset filtering can be found **here** 📒

Dataset information

• —292,637 audio-text pairs
• —397.54 hours of sfw audio (86.8%)
• —52.36 hours of nsfw audio (13.2%)
• —5.3s average sfw audio length
• —Dataset source: visual novels
• —Audio format: mp3 (128kbps)
• —Latest version: V2 - June 29th 2024 (this means the second version of the japanese-anime-speech-v2)

Changes from V1

• —Significantly increased dataset size from 73,004 to 292,637 audio-text pairs
• —Changed audio from mp3 (192kbps) -> mp3 (128kbps) for better storage efficiency
• —sfw and nsfw are on different splits
• —Repeating characters have been normalised (eg.「はーーーーーーい！」 has become 「はーーい！」)
• —Removed audio lines containing no dialogue
• —Removed low quality audio lines

Bias and Limitations

This dataset, while valuable for training anime-style Japanese speech recognition, has some inherent biases and limitations. The audio is primarily sourced from visual novels, leading to a gender bias towards female voices and a domain-specific vocabulary revolving around topics such as love, relationships, and fantasy. Additionally, the professionally produced nature of the audio results in clear and slow speech, which may not fully reflect real-world speaking patterns. This version includes NSFW content, which is not suitable for all applications. No formatting or cleaning of the transcriptions has been performed (e.g. removing duplicate characters), which may affect the quality of some text samples.

Future Plans

• —Continue expanding the dataset to include more sources

Use & Credit

This dataset is openly available for commercial or non-commercial use. Anyone is welcome to use this dataset as they deem appropriate. However, the creator assumes no responsibility for the consequences of its use. While not mandatory, crediting this dataset with a hyperlink in any derivative work would be greatly appreciated.

I hope that by sharing this dataset, we (the open-source community) improve automatic speech recognition for anime content.