datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
msmarco-v2.1-snowflake-arctic-embed-l
Snowflake Arctic Embed L Embeddings for MSMARCO V2.1 for TREC-RAG
This dataset contains the embeddings for the MSMARCO-V2.1 dataset which is used as the corpora for TREC RAG
All embeddings are created using Snowflake's Arctic Embed L and are intended to serve as a simple baseline for dense retrieval-based methods.
Retrieval Performance
Retrieval performance for the TREC DL21-23, MSMARCOV2-Dev and Raggy Queries can be found below with BM25 as a baseline. For both… See the full description on the dataset page: https://huggingface.co/datasets/Snowflake/msmarco-v2.1-snowflake-arctic-embed-l.mteb-retrieval-snowflake-arctic-embed-m-v1.5msmarco-v2.1-snowflake-arctic-embed-m-v1.5
Snowflake Arctic Embed M V1.5 Embeddings for MSMARCO V2.1 for TREC-RAG
This dataset contains the embeddings for the MSMARCO-V2.1 dataset which is used as the corpora for TREC RAG
All embeddings are created using Snowflake's Arctic Embed M v1.5 and are intended to serve as a simple baseline for dense retrieval-based methods.
It's worth noting that Snowflake's Arctic Embed M v1.5 is optimized for efficient embeddings and thus supports embedding truncation and quantization. More… See the full description on the dataset page: https://huggingface.co/datasets/Snowflake/msmarco-v2.1-snowflake-arctic-embed-m-v1.5.arctic-embed-ft-v1
Data for the Arctic Embed walkthrough
This dataset coresponds to the walkthrough example for using the Arctic Embed training code in ArcticTraining. See that README for more details.
Example: Selective downloads via Git LFS
Since this dataset contains various intermediate files not necessary for training, it can be helpful to use the Git LFS backend of Hugging Face Datasets to pull select files.
# First, ensure you have installed git-lfs (see `https://git-lfs.com/`… See the full description on the dataset page: https://huggingface.co/datasets/Snowflake/arctic-embed-ft-v1.msmarco-v2.1-snowflake-arctic-embed-m-v2.0
Snowflake Arctic Embed M V2.0 Embeddings for MSMARCO V2.1 for TREC-RAG
This dataset contains the embeddings for the MSMARCO-V2.1 dataset which is used as the corpora for TREC RAG
All embeddings are created using Snowflake's Arctic Embed M v2.0 and are intended to serve as a simple baseline for dense retrieval-based methods.
Note, that the embeddings are not normalized so you will need to normalize them before usage.
Retrieval Performance
Retrieval performance for… See the full description on the dataset page: https://huggingface.co/datasets/Snowflake/msmarco-v2.1-snowflake-arctic-embed-m-v2.0.nanobeir-snowflake-arctic-embed-m-v1.5snowflake-arctic-embed-m-v1.5bgh-embeddings-snowflake-arctic-l-v2
BGH Leitsatz Embeddings — snowflake-arctic-l-v2
Modell: Snowflake/snowflake-arctic-embed-l-v2.0Datensatz: cwinkler/bgh-leitsaetzeEinträge: 21506Dimension: 1024Normalisiert: True (Cosine Similarity)Lizenz: Apache 2.0
Wichtig: Query-Prefix
Snowflake Arctic verwendet einen Query-Prefix nur für Suchanfragen.
Dokumente werden ohne Prefix eingebettet.
# Queries:
query_emb = model.encode("query: Kann KI Erfinder sein?", normalize_embeddings=True)
# Dokumente (kein… See the full description on the dataset page: https://huggingface.co/datasets/cwinkler/bgh-embeddings-snowflake-arctic-l-v2.snowflake-arctic-embed-l-v2.0embedded_testdata_snowflake_arctic_embed_lSnowflake-snowflake-arctic-embed-sarguana-text-30msmarco-v2.1-snowflake-arctic-embed-l-v2.0MSMARCObm25Triplets-labeled-MarginMSE-snowflake-arctic-embed-lChromaDB-snowflake-arctic-embed-l-v2.0-ko-Kowiki-250611