EMBO/soda-vec-data-full_pmc_title_abstract
SODA-VEC Clean Dataset This is a cleaned and filtered version of the SODA-VEC dataset, containing high-quality biomedical title-abstract pairs from PubMed Central (PMC) articles. Dataset Overview Total examples: 26,573,900 Training set: 26,473,900 examples (99.6%) Validation set: 50,000 examples (0.2%) Test set: 50,000 examples (0.2%) Quality Filtering Applied This dataset has been processed with the following quality filters: Abstract… See the full description on the dataset page: https://huggingface.co/datasets/EMBO/soda-vec-data-full_pmc_title_abstract.
Upload clean SODA-VEC dataset with 26.57M examples - retry with updated libraries (part 00001-of-00002)
Upload clean SODA-VEC dataset with 26.57M examples - retry with updated libraries (part 00000-of-00002)
Add comprehensive dataset card with visualizations and statistics
Add length statistics table
Add length distribution visualization
initial commit
