asr-benchmark
amharic-asr-benchmark
Amharic ASR Benchmark
An evaluation of open speech recognition models for Amharic, on a test set with
certain labels and honest statistics.
16 models. 1,548 clips. 4.72 hours. Every hypothesis published.
Published by Dataset.ET.
Read this table first
Round 1 of this benchmark rested on a single clean claim: every model predated
our dataset, so none could have trained on it. That claim no longer holds.
Models trained on snapwre/amharic-speech now exist, and others… See the full description on the dataset page: https://huggingface.co/datasets/snapwre/amharic-asr-benchmark.quranic-asr-benchmark
Quranic ASR Benchmark - leakage-free, held-out
A small, leakage-free benchmark (600 clips) for evaluating Arabic ASR on Quranic recitation
(Hafs riwayah). Every clip is verified absent from our training data, so it measures
generalization, not memorization. Same clips + same scoring for every model.
📊 Live leaderboard: https://huggingface.co/spaces/Muno459/quranic-asr-leaderboard
The set (600 clips, 200 per source)
Source
n
What it is
everyayah_heldout… See the full description on the dataset page: https://huggingface.co/datasets/Quran-Lab/quranic-asr-benchmark.a5sv2-asr-benchmark-dataset
A5Sv2 ASR Benchmark Dataset
Public references, saved predictions, scores, and provenance for the
A5Sv2 ASR benchmark. The benchmark evaluates
streaming English ASR on four fixed public corpora with approximately equal normalized reference
word counts.
Corpus
Fixed selection
Reference words
Audio in this repository
Mega-ASR / Voices-in-the-Wild-2M
1,250 utterances, 250 per acoustic condition
32,928
Yes
AMI
7 scenario-only unseen-evaluation meetings
32,928
Yes
DiPCo… See the full description on the dataset page: https://huggingface.co/datasets/AirCaps/a5sv2-asr-benchmark-dataset.asr_benchmark_storePersian-ASR-BenchmarkThis dataset consists of 3 hours of 16kHz audio collected from diverse environments to better represent real-world scenarios. The recordings were sourced from audiobooks, YouTube, and other public sources, ensuring a wide variety of speech styles and acoustic conditions.
One key advantage of this dataset is that it was collected from recent sources within the last few months, ensuring no overlap with training data and fairness for evaluating other STT models.
To enable a robust and fair… See the full description on the dataset page: https://huggingface.co/datasets/C1Tech/Persian-ASR-Benchmark.clipquill-asr-benchmark
Measuring whisper-tiny vs whisper-base in a browser tab
Word error rate, wall-clock timing, transfer size and peak memory for two
quantised Whisper tiers running entirely client-side in a real Chrome window,
with the scripts that produced every number.
If you are building an in-browser transcription page, the two results worth
knowing before you pick a model tier:
On clean synthetic audio the two tiers tie. If that is all you test, you
will conclude the tier does not matter… See the full description on the dataset page: https://huggingface.co/datasets/sophia8888/clipquill-asr-benchmark.