CoolFace
Modelpublic

TalTechNLP/xls-r-300m-et

sourceHugging Facecc-by-4.0updated 4y agoView on Hugging Face
2likes1.3kdownloads
Model Card

XLS-R-300m-ET

This is a XLS-R-300M model facebook/wav2vec2-xls-r-300m finetuned on around 800 hours of diverse Estonian data.

Model description

This is a general-purpose Estonian ASR model trained in the Lab of Language Technology at TalTech. It consists of only the CTC-based end-to-end model, no language model is currently provided.

Intended uses & limitations

This model is intended for general-purpose speech recognition, such as broadcast conversations, interviews, talks, etc.

How to use

TODO

Limitations and bias

Since this model was trained on mostly broadcast speech and texts from the web, it might have problems correctly decoding the following:

  • —Speech containing technical and other domain-specific terms
  • —Children's speech
  • —Non-native speech
  • —Speech recorded under very noisy conditions or with a microphone far from the speaker
  • —Very spontaneous and overlapping speech

Training data

Acoustic training data:

TypeAmount (h)
Broadcast speech591
Spontaneous speech53
Elderly speech corpus53
Talks, lectures49
Parliament speeches31
Total761

Training procedure

Finetuned using Fairseq.

Evaluation results

WER

DatasetWER
jutusaated.devset7.9
jutusaated.testset6.1
Common Voice 6.112.5
Common Voice 8.013.4