mld
Datasets
All datasets matching “mld”MLDR
Dataset Summary
MLDR is a Multilingual Long-Document Retrieval dataset built on Wikipeida, Wudao and mC4, covering 13 typologically diverse languages. Specifically, we sample lengthy articles from Wikipedia, Wudao and mC4 datasets and randomly choose paragraphs from them. Then we use GPT-3.5 to generate questions based on these paragraphs. The generated question and the sampled article constitute a new text pair to the dataset. The prompt for GPT3.5 is “You are a curious AI… See the full description on the dataset page: https://huggingface.co/datasets/Shitao/MLDR.mldr
Dataset Card for MLDR
This is a reformatting of the MLDR dataset used to train the BGE-M3 model. See the full BGE-M3 dataset in Shitao/bge-m3-data.
Dataset Subsets
...-triplet subset
Columns: "anchor", "positive", "negative"
Column types: str, str, str
Examples:{
'anchor': '¿Cuál es el efecto de la dilución crema simple en los pelajes básicos de los caballos?',
'positive': 'Gen crema\n\nPelajes resultantes\n\nTodos los caballos tienen dos copias del gen… See the full description on the dataset page: https://huggingface.co/datasets/sentence-transformers/mldr.mldr-conteb-train
ConTEB - MLDR (training)
This dataset is part of ConTEB (Context-aware Text Embedding Benchmark), designed for evaluating contextual embedding model capabilities. It stems from the widely used MLDR dataset.
Dataset Summary
MLDR consists of long documents, associated to existing sets of question-answer pairs. To build the corpus, we start from the pre-existing collection documents, extract the text, and chunk them (using LangChain's RecursiveCharacterSplitter with a… See the full description on the dataset page: https://huggingface.co/datasets/illuin-conteb/mldr-conteb-train.Wis_Holdout_NewCZAI_Summer_School-MLDE_landscapes
CZAI Summer School 2026 — MLDE / BOES landscape data
Precomputed data backing the BOES (Bayesian Optimization in Embedding Space)
directed-evolution demo notebook for the CZAI Summer School 2026 lecture
"AI pro enzymy". See the notebook
CZAI_Summer_School-MLDE_BOES.ipynb
for how this data is used.
This repo hosts, for three combinatorial 4-site protein fitness landscapes
(GB1, PhoQ, TrpB):
*_fitness_full.csv — the full variant,fitness table, always exactly
160,000 rows — the… See the full description on the dataset page: https://huggingface.co/datasets/soldatmat/CZAI_Summer_School-MLDE_landscapes.ocr-mldr
OCR-MLDR
An OCR-degraded version of the Multi Long Document Retrieval (MLDR) benchmark, designed to evaluate embedding models on noisy, OCR-like text with long documents.
Dataset Description
A 2,000-document subsample per language was drawn from mteb/MultiLongDocRetrieval (test split).
Each passage and query was rendered as a PDF at a specific DPI / font-size setting and
re-extracted via OCR using the
ocr-robust-multilingual-embeddings
OCR simulator to introduce realistic… See the full description on the dataset page: https://huggingface.co/datasets/Psychias/ocr-mldr.