mteb/rendered-sts13
Dataset Summary This dataset is rendered to images from STS-13. We envision the need to assess vision encoders' abilities to understand texts. A natural way will be assessing them with the STS protocols, with texts rendered into images. Examples of Use Load test split: from datasets import load_dataset dataset = load_dataset("Pixel-Linguist/rendered-sts13", split="test") Languages English-only; for multilingual and cross-lingual datasets, see… See the full description on the dataset page: https://huggingface.co/datasets/mteb/rendered-sts13.
Dataset Summary
This dataset is rendered to images from STS-13. We envision the need to assess vision encoders' abilities to understand texts. A natural way will be assessing them with the STS protocols, with texts rendered into images.
Examples of Use
Load test split:
from datasets import load_dataset
dataset = load_dataset("Pixel-Linguist/rendered-sts13", split="test")Languages
English-only; for multilingual and cross-lingual datasets, see Pixel-Linguist/rendered-stsb and Pixel-Linguist/rendered-sts17
Citation Information
@article{xiao2024pixel,
title={Pixel Sentence Representation Learning},
author={Xiao, Chenghao and Huang, Zhuoxu and Chen, Danlu and Hudson, G Thomas and Li, Yizhi and Duan, Haoran and Lin, Chenghua and Fu, Jie and Han, Jungong and Moubayed, Noura Al},
journal={arXiv preprint arXiv:2402.08183},
year={2024}
}