datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Morocco-Darija-Sentence-Embedding-Benchmark
Moroccan Darija Sentence Embedding Benchmark
This dataset is human-annotated benchmark for evaluating sentence embeddings models in Moroccan Darija (الدارجة المغربية) also known as ary.
It was currated by Abdeljalil EL Majjodi, Abdelaziz Bounhar and Amine Hani.
The dataset consists of sentence pairs with similarity scores assigned by the human annotators listed above, specifically designed to assess the performance of sentence embedding models on Moroccan Darija text. In particular… See the full description on the dataset page: https://huggingface.co/datasets/atlasia/Morocco-Darija-Sentence-Embedding-Benchmark.pubmed_embedding
PubMed Embeddings Dataset
This dataset contains embeddings generated from the PubMed dataset, which can be found at https://huggingface.co/datasets/ncbi/pubmed. The embeddings were created using the NeuML/pubmedbert-base-embedding model.
Dataset Structure
Each line in the dataset represents a single embedding in the form of a list. The format for each entry is defined as follows:
node.id_ = f"node-{tpubmed}-{idx}"
node.metadata["title"] = ttitle
node.metadata["author"] =… See the full description on the dataset page: https://huggingface.co/datasets/ATLASBIOINFO/pubmed_embedding.embedding_ds_alignement
Dataset Card for embedding_ds_alignement
This dataset has been created with Argilla. As shown in the sections below, this dataset can be loaded into your Argilla server as explained in Load with Argilla, or used directly with the datasets library in Load with datasets.
Using this dataset with Argilla
To load with Argilla, you'll just need to install Argilla as pip install argilla --upgrade and then use the following code:
import argilla as rg
ds =… See the full description on the dataset page: https://huggingface.co/datasets/atlasia/embedding_ds_alignement.