datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
LMEB
🚀 LMEB is now officially supported by MTEB.You can evaluate embedding models on LMEB through the standard MTEB evaluation framework. After running the benchmark, results can be submitted to the MTEB results repository. Once merged, the LMEB leaderboard will be updated on the MTEB Leaderboard.
🔥 Why LMEB?
LMEB fills a crucial gap in current embedding benchmarks, offering a standardized and reproducible… See the full description on the dataset page: https://huggingface.co/datasets/KaLM-Embedding/LMEB.LMEBLMEB_SciFact
LMEB_SciFact
An MTEB dataset
Massive Text Embedding Benchmark
LMEB semantic retrieval task based on SciFact, retrieving scientific evidence passages for claim verification.
Task category
Retrieval (text-to-text)
Domains
Academic, Written
Reference
LMEB: Long-horizon Memory Embedding Benchmark
Source datasets:
KaLM-Embedding/LMEB
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task… See the full description on the dataset page: https://huggingface.co/datasets/mteb/LMEB_SciFact.LMEBMLDR
MLDR
An MTEB dataset
Massive Text Embedding Benchmark
LMEB semantic retrieval task based on MLDR, focused on long-document retrieval for question answering in English.
Task category
Retrieval (text-to-text)
Domains
Web, Written
Reference
LMEB: Long-horizon Memory Embedding Benchmark
Source datasets:
KaLM-Embedding/LMEB
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/LMEBMLDR.