orionweller/LIMIT-small-synonyms

LIMIT-small A retrieval dataset that exposes fundamental theoretical limitations of embedding-based retrieval models. Despite using simple queries like "Who likes Apples?", state-of-the-art embedding models achieve less than 20% recall@100 on LIMIT full and cannot solve LIMIT-small (46 docs). Introduction Vector embeddings have been tasked with an ever-increasing set of retrieval tasks over the years, with a nascent rise in using them for reasoning… See the full description on the dataset page: https://huggingface.co/datasets/orionweller/LIMIT-small-synonyms.