CoolFace
30 shown

datasets

Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.

modalityAllTextImageAudioTabularVideo
taskAllText generationQuestion answeringImage classificationSpeech
sizeAllUnder 1K1K – 10K100K – 1M1M – 10M
formatAllParquetJSONCSVWebDataset
sortTrendingMost likedMost usedRecently updatedNewest
Clear all
01mteb /resultstext1M<n<10M18 likes332k downloads1h agoHugging Face02mteb /sts12-sts STS12 An MTEB dataset Massive Text Embedding Benchmark SemEval-2012 Task 6. Task category t2t Domains Encyclopaedic, News, Written Reference https://www.aclweb.org/anthology/S12-1051.pdf How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["STS12"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL) evaluator.run(model) To learn more about how to… See the full description on the dataset page: https://huggingface.co/datasets/mteb/sts12-sts.textsentence-similarity1K<n<10K8 likes82k downloads7mo agoHugging Face03morteza20 /mteb_leaderboard [!NOTE]Previously it was possible to submit models results to MTEB by adding the results to the model metadata. This is no longer an option as we want to ensure high quality metadata. This repository contain the results of the embedding benchmark evaluated using the package mteb. Reference 🦾 Leaderboard An up to date leaderboard of embedding models 📚 mteb Guides and instructions on how to use mteb, including running, submitting scores, etc. 🙋 Questions Questions about the… See the full description on the dataset page: https://huggingface.co/datasets/morteza20/mteb_leaderboard.0 likes70k downloads2y agoHugging Face04mteb /nfcorpus NFCorpus An MTEB dataset Massive Text Embedding Benchmark NFCorpus: A Full-Text Learning to Rank Dataset for Medical Information Retrieval Task category t2t Domains Medical, Academic, Written Reference https://www.cl.uni-heidelberg.de/statnlpgroup/nfcorpus/ How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["NFCorpus"]) evaluator = mteb.MTEB(task) model =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/nfcorpus.texttext-retrieval100K<n<1M3 likes48k downloads1y agoHugging Face05mteb /amazon_massive_intent MassiveIntentClassification An MTEB dataset Massive Text Embedding Benchmark MASSIVE: A 1M-Example Multilingual Natural Language Understanding Dataset with 51 Typologically-Diverse Languages Task category t2c Domains Spoken Reference https://arxiv.org/abs/2204.08582 How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["MassiveIntentClassification"]) evaluator =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/amazon_massive_intent.texttext-classification100K<n<1M27 likes38k downloads7mo agoHugging Face06mteb /sts22-crosslingual-sts STS22.v2 An MTEB dataset Massive Text Embedding Benchmark SemEval 2022 Task 8: Multilingual News Article Similarity. Version 2 filters updated on STS22 by removing pairs where one of entries contain empty sentences. Task category t2t Domains News, Written Reference https://competitions.codalab.org/competitions/33835 How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/sts22-crosslingual-sts.textsentence-similarity10K<n<100K16 likes32k downloads7mo agoHugging Face07mteb /arguana ArguAna An MTEB dataset Massive Text Embedding Benchmark ArguAna: Retrieval of the Best Counterargument without Prior Topic Knowledge Task category Retrieval (text-to-text) Domains Social, Web, Written Reference ACL Source datasets: mteb/arguana How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_task("ArguAna") evaluator = mteb.MTEB([task]) model =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/arguana.texttext-retrieval10K<n<100K7 likes27k downloads5mo agoHugging Face08mteb /sickr-sts SICK-R An MTEB dataset Massive Text Embedding Benchmark Semantic Textual Similarity SICK-R dataset Task category t2t Domains Web, Written Reference https://aclanthology.org/L14-1314/ How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["SICK-R"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL) evaluator.run(model) To learn more about how to run models… See the full description on the dataset page: https://huggingface.co/datasets/mteb/sickr-sts.textsentence-similarity1K<n<10K5 likes24k downloads7mo agoHugging Face09mteb /sts13-sts STS13 An MTEB dataset Massive Text Embedding Benchmark SemEval STS 2013 dataset. Task category t2t Domains Web, News, Non-fiction, Written Reference https://www.aclweb.org/anthology/S13-1004/ How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["STS13"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL) evaluator.run(model) To learn more about how… See the full description on the dataset page: https://huggingface.co/datasets/mteb/sts13-sts.textsentence-similarity1K<n<10K1 likes23k downloads7mo agoHugging Face10mteb /sts14-sts STS14 An MTEB dataset Massive Text Embedding Benchmark SemEval STS 2014 dataset. Currently only the English dataset Task category t2t Domains Blog, Web, Spoken Reference https://www.aclweb.org/anthology/S14-1002 How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["STS14"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL) evaluator.run(model) To… See the full description on the dataset page: https://huggingface.co/datasets/mteb/sts14-sts.textsentence-similarity1K<n<10K2 likes23k downloads7mo agoHugging Face11mteb /scifact SciFact An MTEB dataset Massive Text Embedding Benchmark SciFact verifies scientific claims using evidence from the research literature containing scientific paper abstracts. Task category t2t Domains Academic, Medical, Written Reference https://github.com/allenai/scifact How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["SciFact"]) evaluator = mteb.MTEB(task)… See the full description on the dataset page: https://huggingface.co/datasets/mteb/scifact.texttext-retrieval1K<n<10K5 likes22k downloads1y agoHugging Face12mteb /banking77 Banking77Classification An MTEB dataset Massive Text Embedding Benchmark Dataset composed of online banking queries annotated with their corresponding intents. Task category t2c Domains Written Reference https://arxiv.org/abs/2003.04807 How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["Banking77Classification"]) evaluator = mteb.MTEB(task) model =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/banking77.texttext-classification10K<n<100K17 likes22k downloads1y agoHugging Face13mteb /biosses-sts BIOSSES An MTEB dataset Massive Text Embedding Benchmark Biomedical Semantic Similarity Estimation. Task category t2t Domains Medical Reference https://tabilab.cmpe.boun.edu.tr/BIOSSES/DataSet.html How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["BIOSSES"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL) evaluator.run(model) To learn more… See the full description on the dataset page: https://huggingface.co/datasets/mteb/biosses-sts.textsentence-similarityn<1K2 likes22k downloads1y agoHugging Face14mteb /scidocs SCIDOCS An MTEB dataset Massive Text Embedding Benchmark SciDocs, a new evaluation benchmark consisting of seven document-level tasks ranging from citation prediction, to document classification and recommendation. Task category t2t Domains Academic, Written, Non-fiction Reference https://allenai.org/data/scidocs How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/scidocs.texttext-retrieval10K<n<100K6 likes21k downloads7mo agoHugging Face15mteb /stsbenchmark-sts STSBenchmark An MTEB dataset Massive Text Embedding Benchmark Semantic Textual Similarity Benchmark (STSbenchmark) dataset. Task category t2t Domains Blog, News, Written Reference https://github.com/PhilipMay/stsb-multi-mt/ How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["STSBenchmark"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL)… See the full description on the dataset page: https://huggingface.co/datasets/mteb/stsbenchmark-sts.textsentence-similarity1K<n<10K19 likes20k downloads7mo agoHugging Face16mteb /twentynewsgroups-clustering TwentyNewsgroupsClustering.v2 An MTEB dataset Massive Text Embedding Benchmark Clustering of the 20 Newsgroups dataset (subject only). Task category t2c Domains News, Written Reference https://scikit-learn.org/0.19/datasets/twenty_newsgroups.html How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["TwentyNewsgroupsClustering.v2"]) evaluator = mteb.MTEB(task)… See the full description on the dataset page: https://huggingface.co/datasets/mteb/twentynewsgroups-clustering.texttext-classificationn<1K1 likes17k downloads1y agoHugging Face17mteb /ClimateFEVER_test_top_250_only_w_correct-v2 ClimateFEVERHardNegatives An MTEB dataset Massive Text Embedding Benchmark CLIMATE-FEVER is a dataset adopting the FEVER methodology that consists of 1,535 real-world claims regarding climate-change. The hard negative version has been created by pooling the 250 top documents per query from BM25, e5-multilingual-large and e5-mistral-instruct. Task category t2t Domains Encyclopaedic, Written Reference https://www.sustainablefinance.uzh.ch/en/research/climate-fever.html… See the full description on the dataset page: https://huggingface.co/datasets/mteb/ClimateFEVER_test_top_250_only_w_correct-v2.texttext-retrieval10K<n<100K0 likes17k downloads1y agoHugging Face18mteb /summeval SummEvalSummarization.v2 An MTEB dataset Massive Text Embedding Benchmark News Article Summary Semantic Similarity Estimation. This version fixes a bug in the evaluation script that caused the main score to be computed incorrectly. Task category t2t Domains News, Written Reference https://github.com/Yale-LILY/SummEval How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/summeval.textsummarizationn<1K11 likes15k downloads1y agoHugging Face19mteb /DBPedia_test_top_250_only_w_correct-v2 DBPediaHardNegatives An MTEB dataset Massive Text Embedding Benchmark DBpedia-Entity is a standard test collection for entity search over the DBpedia knowledge base. The hard negative version has been created by pooling the 250 top documents per query from BM25, e5-multilingual-large and e5-mistral-instruct. Task category t2t Domains Written, Encyclopaedic Reference https://github.com/iai-group/DBpedia-Entity/ How to evaluate on this task You can evaluate… See the full description on the dataset page: https://huggingface.co/datasets/mteb/DBPedia_test_top_250_only_w_correct-v2.texttext-retrieval100K<n<1M0 likes12k downloads1y agoHugging Face20mteb /BornholmBitextMining BornholmBitextMining An MTEB dataset Massive Text Embedding Benchmark Danish Bornholmsk Parallel Corpus. Bornholmsk is a Danish dialect spoken on the island of Bornholm, Denmark. Historically it is a part of east Danish which was also spoken in Scania and Halland, Sweden. Task categoryt2t Domains Web, Social, Fiction, Written Reference https://aclanthology.org/W19-6138/ Source datasets: strombergnlp/bornholmsk_parallel How to evaluate on this task… See the full description on the dataset page: https://huggingface.co/datasets/mteb/BornholmBitextMining.texttranslation1K<n<10K0 likes11k downloads7mo agoHugging Face21mteb /fiqa FiQA2018 An MTEB dataset Massive Text Embedding Benchmark Financial Opinion Mining and Question Answering Task category t2t Domains Written, Financial Reference https://sites.google.com/view/fiqa/ How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["FiQA2018"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL) evaluator.run(model) To learn more… See the full description on the dataset page: https://huggingface.co/datasets/mteb/fiqa.texttext-retrieval10K<n<100K5 likes11k downloads1y agoHugging Face22mteb /SciDocsRR SciDocsRR An MTEB dataset Massive Text Embedding Benchmark Ranking of related scientific papers based on their title. Task category t2t Domains Academic, Non-fiction, Written Reference https://allenai.org/data/scidocs How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["SciDocsRR"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL)… See the full description on the dataset page: https://huggingface.co/datasets/mteb/SciDocsRR.texttext-ranking100K<n<1M0 likes10k downloads1y agoHugging Face23mteb /MIRACLRetrievalHardNegatives MIRACLRetrievalHardNegatives An MTEB dataset Massive Text Embedding Benchmark MIRACL (Multilingual Information Retrieval Across a Continuum of Languages) is a multilingual retrieval dataset that focuses on search across 18 different languages. The hard negative version has been created by pooling the 250 top documents per query from BM25, e5-multilingual-large and e5-mistral-instruct. Task category t2t Domains Encyclopaedic, Written Reference http://miracl.ai/… See the full description on the dataset page: https://huggingface.co/datasets/mteb/MIRACLRetrievalHardNegatives.texttext-retrieval1M<n<10M3 likes9.4k downloads7mo agoHugging Face24mteb /Core17InstructionRetrieval Core17InstructionRetrieval An MTEB dataset Massive Text Embedding Benchmark Measuring retrieval instruction following ability on Core17 narratives for the FollowIR benchmark. Task category t2t Domains News, Written Referencehttps://arxiv.org/abs/2403.15246 Source datasets: jhu-clsp/core17-instructions-mteb How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/Core17InstructionRetrieval.texttext-ranking10K<n<100K0 likes8.5k downloads7mo agoHugging Face25mteb /sts15-sts STS15 An MTEB dataset Massive Text Embedding Benchmark SemEval STS 2015 dataset Task category t2t Domains Blog, News, Web, Written, Spoken Reference https://www.aclweb.org/anthology/S15-2010 How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["STS15"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL) evaluator.run(model) To learn more about how… See the full description on the dataset page: https://huggingface.co/datasets/mteb/sts15-sts.textsentence-similarity1K<n<10K2 likes8.4k downloads7mo agoHugging Face26mteb /arena-resultsThis dataset contains the saved results from MTEB-Arena tabular1K<n<10K4 likes8.2k downloads1y agoHugging Face27mteb /FaroeseSTS FaroeseSTS An MTEB dataset Massive Text Embedding Benchmark Semantic Text Similarity (STS) corpus for Faroese. Task category t2t Domains News, Web, Written Reference https://aclanthology.org/2023.nodalida-1.74.pdf How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["FaroeseSTS"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL) evaluator.run(model)… See the full description on the dataset page: https://huggingface.co/datasets/mteb/FaroeseSTS.textsentence-similarityn<1K0 likes8.1k downloads1y agoHugging Face28mteb /trec-covid TRECCOVID An MTEB dataset Massive Text Embedding Benchmark TRECCOVID is an ad-hoc search challenge based on the COVID-19 dataset containing scientific articles related to the COVID-19 pandemic. Task category t2t Domains Medical, Academic, Written Reference https://ir.nist.gov/covidSubmit/index.html How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["TRECCOVID"])… See the full description on the dataset page: https://huggingface.co/datasets/mteb/trec-covid.texttext-retrieval100K<n<1M5 likes7.5k downloads7mo agoHugging Face29mteb /sprintduplicatequestions-pairclassification SprintDuplicateQuestions An MTEB dataset Massive Text Embedding Benchmark Duplicate questions from the Sprint community. Task category t2t Domains Programming, Written Reference https://www.aclweb.org/anthology/D18-1131/ How to evaluate on this task You can evaluate an embedding model on this dataset using the following code: import mteb task = mteb.get_tasks(["SprintDuplicateQuestions"]) evaluator = mteb.MTEB(task) model = mteb.get_model(YOUR_MODEL)… See the full description on the dataset page: https://huggingface.co/datasets/mteb/sprintduplicatequestions-pairclassification.texttext-classificationn<1K0 likes7.2k downloads7mo agoHugging Face30mteb /fleursaudio100K<n<1M0 likes7.1k downloads3mo agoHugging Face

Listings come live from the Hugging Face Hub API. CoolFace does not host these files.