stsb
Datasets
All datasets matching “stsb”stsbenchmark-sts
STSBenchmark
An MTEB dataset
Massive Text Embedding Benchmark
Semantic Textual Similarity Benchmark (STSbenchmark) dataset.
Task category
t2t
Domains
Blog, News, Written
Reference
https://github.com/PhilipMay/stsb-multi-mt/
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task = mteb.get_tasks(["STSBenchmark"])
evaluator = mteb.MTEB(task)
model = mteb.get_model(YOUR_MODEL)… See the full description on the dataset page: https://huggingface.co/datasets/mteb/stsbenchmark-sts.stsb
Dataset Card for STSB
The Semantic Textual Similarity Benchmark (Cer et al., 2017) is a collection of sentence pairs drawn from news headlines, video and image captions, and natural language inference data.
Each pair is human-annotated with a similarity score from 1 to 5. However, for this variant, the similarity scores are normalized to between 0 and 1.
Dataset Details
Columns: "sentence1", "sentence2", "score"
Column types: str, str, float
Examples:{
'sentence1': 'A… See the full description on the dataset page: https://huggingface.co/datasets/sentence-transformers/stsb.stsb_multi_mt
Dataset Card for STSb Multi MT
Dataset Summary
STS Benchmark comprises a selection of the English datasets used in the STS tasks organized
in the context of SemEval between 2012 and 2017. The selection of datasets include text from
image captions, news headlines and user forums. (source)
These are different multilingual translations and the English original of the STSbenchmark dataset. Translation has been done with deepl.com. It can be used to train sentence embeddings… See the full description on the dataset page: https://huggingface.co/datasets/PhilipMay/stsb_multi_mt.STSB
STSB
An MTEB dataset
Massive Text Embedding Benchmark
A Chinese dataset for textual relatedness
Task category
t2t
Domains
None
Reference
https://aclanthology.org/2021.emnlp-main.357
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task = mteb.get_task("STSB")
evaluator = mteb.MTEB([task])
model = mteb.get_model(YOUR_MODEL)
evaluator.run(model)
To learn more about how to run models on… See the full description on the dataset page: https://huggingface.co/datasets/mteb/STSB.stsb-mt-turkish
STSb Turkish
Semantic textual similarity dataset for the Turkish language. It is a machine translation (Azure) of the STSb English dataset. This dataset is not reviewed by expert human translators.
Uploaded from this repository.
Citing & Authors
@misc{celik2020stsbtr,
author = {Emrecan Çelik},
title = {STSB-MT-Turkish},
howpublished = {Hugging Face dataset repository},
url = {https://huggingface.co/datasets/emrecan/stsb-mt-turkish}… See the full description on the dataset page: https://huggingface.co/datasets/emrecan/stsb-mt-turkish.stsb_multi_mt_22lang