hume
Datasets
All datasets matching “hume”hf-assetshearing2translate-humeval
This repository contains the human evaluation experiment data for Hearing to Translate: The Effectiveness of Speech Modality Integration into LLMs 📄.
The code for the project is hosted at github.com/sarapapi/hearing2translate.
The annotations were collected using Pearmut (code), a lightweight platform that makes end-to-end human evaluation for multilingual tasks efficient and reliable.
The evaluations were done with bilingual speakers using the Pearmut tool with the MQM/ESA protocol… See the full description on the dataset page: https://huggingface.co/datasets/zouhar/hearing2translate-humeval.HUMEWikipediaRerankingMultilingual
HUMEWikipediaRerankingMultilingual
An MTEB dataset
Massive Text Embedding Benchmark
Human evaluation subset of Wikipedia reranking dataset across multiple languages.
Task category
t2t
Domains
Encyclopaedic, Written
Referencehttps://github.com/ellamind/wikipedia-2023-11-reranking-multilingual
Source datasets:
mteb/WikipediaRerankingMultilingual
mteb/mteb-human-wiki-reranking
How to evaluate on this task
You can evaluate an embedding model on this… See the full description on the dataset page: https://huggingface.co/datasets/mteb/HUMEWikipediaRerankingMultilingual.HUMEToxicConversationsClassificationHUMEEmotionClassificationhum_eye4b
Dataset Card for "hum_eye4b"
More Information needed