espnet/multi-talker-whisper-small-ami

multi-talker-whisper-small-ami

ESPnet checkpoint for serialized-output-training (SOT) multi-talker ASR on the AMI meeting corpus, built on top of openai/whisper-small. Trained to emit a single transcript containing every speaker, separated by a speaker-change token, with per-speaker Whisper-style timestamps.

Files

Usage

This checkpoint is consumed by the `egs2/ami/sot_asr1` recipe. After cloning ESPnet and preparing the AMI test data, place the three files under exp/whisper-sot-small-ami/ and run:

./run.sh --released_model exp/whisper-sot-small-ami \
         --whisper_model small \
         --decode_test_sets test

The recipe prints utterance-group cpWER and utterance-group DER under exp/whisper-sot-small-ami/decode_released/test/eval/.

Results (AMI SDM test, beam = 5, temperature = 0)

cpWER (%)

DER (collar = 0.25 s, %)