CoolFace
Datasetpublic

Trelis/eval-universal-3-pro-multimed-hard-20260408-1933

Evaluation Results: universal-3-pro Evaluation results from Whisper model evaluation. Summary Model WER CER assemblyai/universal-3-pro 12.53% 10.02% Source Data Evaluation Dataset: Trelis/multimed-hard Model Evaluated: assemblyai/universal-3-pro Columns Column Description audio Audio sample (if available from source dataset) reference Ground truth transcription prediction Model prediction wer Word… See the full description on the dataset page: https://huggingface.co/datasets/Trelis/eval-universal-3-pro-multimed-hard-20260408-1933.

sourceHugging Faceupdated 6mo agoView on Hugging Face
0likes11downloads
Dataset Card

Evaluation Results: universal-3-pro

Evaluation results from Whisper model evaluation.

Summary

ModelWERCER
assemblyai/universal-3-pro12.53%10.02%

Source Data

Columns

ColumnDescription
audioAudio sample (if available from source dataset)
referenceGround truth transcription
predictionModel prediction
werWord Error Rate for this sample
cerCharacter Error Rate for this sample

| entities | Entity annotations from source dataset | | entity_cer | Per-sample entity CER (-1.0 if no entities) |

Entity CER

Overall Entity CER: 23.37%

CategoryCER
anatomy10.64%
biomarker13.06%
condition35.07%
drug0.00%
organisation21.78%
procedure31.36%

Generated by [Trelis Studio](https://studio.trelis.com)