mmteb
Datasets
All datasets matching “mmteb”biblenlp-corpus-mmtebThis dataset pre-computes all English-centric directions from bible-nlp/biblenlp-corpus, and as a result loading is significantly faster.
Loading example:
>>> from datasets import load_dataset
>>> dataset = load_dataset("davidstap/biblenlp-corpus-mmteb", "eng-arb", trust_remote_code=True)
>>> dataset
DatasetDict({
train: Dataset({
features: ['eng', 'arb'],
num_rows: 28723
})
validation: Dataset({
features: ['eng', 'arb'],
num_rows: 1578
})… See the full description on the dataset page: https://huggingface.co/datasets/davidstap/biblenlp-corpus-mmteb.biblenlp-corpus-mmteb
BibleNLPBitextMining
An MTEB dataset
Massive Text Embedding Benchmark
Partial Bible translations in 829 languages, aligned by verse.
Task category
t2t
Domains
Religious, Written
Reference
https://arxiv.org/abs/2304.09919
Source datasets:
davidstap/biblenlp-corpus-mmteb
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task = mteb.get_task("BibleNLPBitextMining")
evaluator =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/biblenlp-corpus-mmteb.mmteb-miracl-rerankingMMTEB-Multilingual-v2
MTEB(Multilingual, v2)
MTEB(Multilingual, v2)
An MTEB benchmark
Massive Text Embedding Benchmark
The large-scale multilingual expansion of MTEB known as MMTEB, driven mainly by highly-curated community contributions covering 250+ languages.
Tasks
Task
Type
Description
BornholmBitextMining
semantic-similarity
Danish Bornholmsk Parallel Corpus. Bornholmsk is a Danish dialect spoken on the island of Bornholm, Denmark. Historically it is a part… See the full description on the dataset page: https://huggingface.co/datasets/mteb/MMTEB-Multilingual-v2.mmteb-miraclbiblenlp-corpus-mmteb