passage-retrieval
poleval2022-passage-retrieval-datasetbge-retrieval-data-ivf-passage-pruning-438KAmharic-Passage-Retrieval-Dataset-V2
Amharic Passage Retrieval Dataset V2
This dataset is the official benchmark for the paper "The Multilingual Curse at the Retrieval Layer: Evidence from Amharic".
It provides a fixed 90/10 train–test split consisting of 68,000 query–passage pairs, specifically designed for evaluating and training dense, late-interaction, learned sparse, and cross-encoder retrieval models for the Amharic language.
GitHub Repository: rasyosef/amharic-neural-ir
Paper: The Multilingual Curse at the… See the full description on the dataset page: https://huggingface.co/datasets/rasyosef/Amharic-Passage-Retrieval-Dataset-V2.amharic-passage-retrieval-dataset-v2-with-negativesAmharic-Passage-Retrieval-Dataset-V2-With-NegativesThis dataset can be used directly with Sentence Transformers to train Amharic Embedding and Reranking models.
The negative_passages column contains 16 negative passages for each query, mined from the training set passages using an embedding model.
Source Datasets:
https://huggingface.co/datasets/rasyosef/amharic-news-category-classification
https://huggingface.co/datasets/rasyosef/xlsum_amharic_summarization
https://huggingface.co/datasets/yosefw/amharic-wikipedia… See the full description on the dataset page: https://huggingface.co/datasets/rasyosef/Amharic-Passage-Retrieval-Dataset-V2-With-Negatives.amharic-passage-retrieval-dataset
Amharic Passage Retrieval Dataset
This dataset is a version of amharic-news-category-classification that has been filtered, deduplicated, and formatted for passage retrieval.
This dataset can be used directly with Sentence Transformers to train Amharic embedding models.
Source Datasets:
https://huggingface.co/datasets/rasyosef/amharic-news-category-classification
Models and Code
The following Text Embedding and ColBERT late-interaction retrieval models were… See the full description on the dataset page: https://huggingface.co/datasets/rasyosef/amharic-passage-retrieval-dataset.
