CoolFace
Datasetpublic

Trelis/eval-Voxtral-Mini-3B-2507-multimed-hard-20260408-1931

Evaluation Results: Voxtral-Mini-3B-2507 Evaluation results from Whisper model evaluation. Summary Model WER CER mistralai/Voxtral-Mini-3B-2507 10.89% 7.46% Source Data Evaluation Dataset: Trelis/multimed-hard Model Evaluated: mistralai/Voxtral-Mini-3B-2507 Columns Column Description audio Audio sample (if available from source dataset) reference Ground truth transcription prediction Model prediction… See the full description on the dataset page: https://huggingface.co/datasets/Trelis/eval-Voxtral-Mini-3B-2507-multimed-hard-20260408-1931.

sourceHugging Faceupdated 6mo agoView on Hugging Face
0likes9downloads
Dataset Card

Evaluation Results: Voxtral-Mini-3B-2507

Evaluation results from Whisper model evaluation.

Summary

ModelWERCER
mistralai/Voxtral-Mini-3B-250710.89%7.46%

Source Data

Columns

ColumnDescription
audioAudio sample (if available from source dataset)
referenceGround truth transcription
predictionModel prediction
werWord Error Rate for this sample
cerCharacter Error Rate for this sample

| entities | Entity annotations from source dataset | | entity_cer | Per-sample entity CER (-1.0 if no entities) |

Entity CER

Overall Entity CER: 27.34%

CategoryCER
anatomy25.53%
biomarker25.82%
condition28.18%
drug0.00%
organisation35.64%
procedure27.81%

Generated by [Trelis Studio](https://studio.trelis.com)