soda-vec
Datasets
All datasets matching “soda-vec”soda-vec-data-full_pmc_title_abstract
SODA-VEC Clean Dataset
This is a cleaned and filtered version of the SODA-VEC dataset, containing high-quality biomedical title-abstract pairs from PubMed Central (PMC) articles.
Dataset Overview
Total examples: 26,573,900
Training set: 26,473,900 examples (99.6%)
Validation set: 50,000 examples (0.2%)
Test set: 50,000 examples (0.2%)
Quality Filtering Applied
This dataset has been processed with the following quality filters:
Abstract Length… See the full description on the dataset page: https://huggingface.co/datasets/EMBO/soda-vec-data-full_pmc_title_abstract.soda-vec-data-full_pmc_title_abstract_paired
SODA-VEC Paired Dataset for Negative Sampling
This is a paired version of the SODA-VEC dataset, specifically formatted for negative sampling training with MultipleNegativesRankingLoss.
Dataset Overview
Total examples: 26,573,900
Format: Paired (anchor-positive) for contrastive learning
Source: EMBO/soda-vec-data-full_pmc_title_abstract
Purpose: Training sentence transformers with negative sampling
Data Format
Each example contains:
anchor (string): The title… See the full description on the dataset page: https://huggingface.co/datasets/EMBO/soda-vec-data-full_pmc_title_abstract_paired.soda-vec-full_pmc_title_abstract