Datasetpublic

Trelis/eval-Voxtral-Mini-3B-2507-eka-hard-20260408-1920

Evaluation Results: Voxtral-Mini-3B-2507 Evaluation results from Whisper model evaluation. Summary Model WER CER mistralai/Voxtral-Mini-3B-2507 43.86% 29.54% Source Data Evaluation Dataset: Trelis/eka-hard Model Evaluated: mistralai/Voxtral-Mini-3B-2507 Columns Column Description audio Audio sample (if available from source dataset) reference Ground truth transcription prediction Model prediction wer… See the full description on the dataset page: https://huggingface.co/datasets/Trelis/eval-Voxtral-Mini-3B-2507-eka-hard-20260408-1920.

sourceHugging Faceupdated 6mo agoView on Hugging Face

0likes14downloads

Dataset Card

Evaluation Results: Voxtral-Mini-3B-2507

Evaluation results from Whisper model evaluation.

Summary

Model	WER	CER
mistralai/Voxtral-Mini-3B-2507	43.86%	29.54%

Source Data

—Evaluation Dataset: Trelis/eka-hard
—Model Evaluated: mistralai/Voxtral-Mini-3B-2507

Columns

Column	Description
`audio`	Audio sample (if available from source dataset)
`reference`	Ground truth transcription
`prediction`	Model prediction
`wer`	Word Error Rate for this sample
`cer`	Character Error Rate for this sample

Entity CER

Overall Entity CER: 42.57%

Category	CER
anatomy	23.53%
biomarker	55.56%
condition	31.09%
drug	45.82%
procedure	59.09%

Generated by [Trelis Studio](https://studio.trelis.com)