Trelis/eval-canary-1b-v2-eka-hard-20260408-1921
Evaluation Results: canary-1b-v2 Evaluation results from Whisper model evaluation. Summary Model WER CER nvidia/canary-1b-v2 39.85% 22.43% Source Data Evaluation Dataset: Trelis/eka-hard Model Evaluated: nvidia/canary-1b-v2 Columns Column Description audio Audio sample (if available from source dataset) reference Ground truth transcription prediction Model prediction wer Word Error Rate for this… See the full description on the dataset page: https://huggingface.co/datasets/Trelis/eval-canary-1b-v2-eka-hard-20260408-1921.
Evaluation Results: canary-1b-v2
Evaluation results from Whisper model evaluation.
Summary
Source Data
- Evaluation Dataset: Trelis/eka-hard
- Model Evaluated: nvidia/canary-1b-v2
Columns
| entities | Entity annotations from source dataset | | entity_cer | Per-sample entity CER (-1.0 if no entities) |
Entity CER
Overall Entity CER: 39.22%
Generated by [Trelis Studio](https://studio.trelis.com)