datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
msmarco-v2.1-snowflake-arctic-embed-l
Snowflake Arctic Embed L Embeddings for MSMARCO V2.1 for TREC-RAG
This dataset contains the embeddings for the MSMARCO-V2.1 dataset which is used as the corpora for TREC RAG
All embeddings are created using Snowflake's Arctic Embed L and are intended to serve as a simple baseline for dense retrieval-based methods.
Retrieval Performance
Retrieval performance for the TREC DL21-23, MSMARCOV2-Dev and Raggy Queries can be found below with BM25 as a baseline. For both… See the full description on the dataset page: https://huggingface.co/datasets/Snowflake/msmarco-v2.1-snowflake-arctic-embed-l.mteb-retrieval-snowflake-arctic-embed-m-v1.5msmarco-v2.1-snowflake-arctic-embed-m-v1.5
Snowflake Arctic Embed M V1.5 Embeddings for MSMARCO V2.1 for TREC-RAG
This dataset contains the embeddings for the MSMARCO-V2.1 dataset which is used as the corpora for TREC RAG
All embeddings are created using Snowflake's Arctic Embed M v1.5 and are intended to serve as a simple baseline for dense retrieval-based methods.
It's worth noting that Snowflake's Arctic Embed M v1.5 is optimized for efficient embeddings and thus supports embedding truncation and quantization. More… See the full description on the dataset page: https://huggingface.co/datasets/Snowflake/msmarco-v2.1-snowflake-arctic-embed-m-v1.5.msmarco-v2.1-snowflake-arctic-embed-m-v2.0
Snowflake Arctic Embed M V2.0 Embeddings for MSMARCO V2.1 for TREC-RAG
This dataset contains the embeddings for the MSMARCO-V2.1 dataset which is used as the corpora for TREC RAG
All embeddings are created using Snowflake's Arctic Embed M v2.0 and are intended to serve as a simple baseline for dense retrieval-based methods.
Note, that the embeddings are not normalized so you will need to normalize them before usage.
Retrieval Performance
Retrieval performance for… See the full description on the dataset page: https://huggingface.co/datasets/Snowflake/msmarco-v2.1-snowflake-arctic-embed-m-v2.0.swe_opsd_datasetnanobeir-snowflake-arctic-embed-m-v1.5scaleswe-opsd-v2-3200-summary
Scale-SWE OPSD v2 — 3200 tasks with summary hints
The training set used for the Scale-SWE on-policy self-distillation (OPSD) runs. 3200 SWE tasks across
752 repositories, each paired with a reference agent trajectory and a condensed solution hint.
Uploaded from /checkpoint/huggingface/datasets/scaleswe_opsd_v2_3200_summary (a
datasets.save_to_disk directory), converted to parquet. Row count, ids and field contents verified
identical to the source.
⚠️ Contains… See the full description on the dataset page: https://huggingface.co/datasets/starli-snowflake/scaleswe-opsd-v2-3200-summary.zsql-snowflake-dpofineweb-edu-healthcare-snowflake-llama3-8bthe scores (int_score) are inversed , 30 and bellow that means that the text is healthcare related. (95% accuracy according to llama-3-8b-instruct as judge)
temp2-with-clip-snowflakev2-embeddingsMSMARCObm25Triplets-labeled-MarginMSE-snowflake-arctic-embed-lfineweb-edu-healthcare-snowflake-llama3-8b-nano-filtered-threshold-30