open-biosciences/biosciences-sources
Biosciences RAG Source Documents Dataset Description This dataset contains 140 page-level document chunks extracted from 10 biomedical research papers. The documents form the knowledge base for a Retrieval-Augmented Generation (RAG) system focused on biosciences topics including knowledge graphs, LLM applications in biomedicine, and protein interaction databases. Dataset Summary Total Documents: 140 pages from 10 research papers Domain: Biomedical… See the full description on the dataset page: https://huggingface.co/datasets/open-biosciences/biosciences-sources.
Biosciences RAG Source Documents
Dataset Description
This dataset contains 140 page-level document chunks extracted from 10 biomedical research papers. The documents form the knowledge base for a Retrieval-Augmented Generation (RAG) system focused on biosciences topics including knowledge graphs, LLM applications in biomedicine, and protein interaction databases.
Dataset Summary
- Total Documents: 140 pages from 10 research papers
- Domain: Biomedical NLP, knowledge graphs, RAG in life sciences
- Format: PDF pages with extracted text and metadata
- Use Case: RAG knowledge base for biosciences-related queries
Source Papers
Data Fields
page_content(string): Extracted text content from the PDF pagemetadata(dict): Document metadata including:title: Paper titleauthor: Paper authorspage: Page numbertotal_pages: Total pages in source documentsource: Original file pathformat: Document format (PDF)producer,creator: PDF metadatakeywords,subject: Paper keywords and subject (where available)
Data Splits
This dataset contains a single split with all 140 documents.
Licensing
This dataset is released under the Apache 2.0 license.
Dataset Creation
Created as part of the Open Biosciences RAG evaluation pipeline. Source PDFs are ingested via make ingest which runs scripts/ingest_raw_pdfs.py with LlamaIndex transformations (HeadlineSplitter, SummaryExtractor, EmbeddingExtractor, ThemesExtractor, NERExtractor).
Related Datasets
- Golden Testset:
open-biosciences/biosciences-golden-testset(12 QA pairs generated from these sources) - Evaluation Inputs:
open-biosciences/biosciences-evaluation-inputs(RAG outputs) - Evaluation Metrics:
open-biosciences/biosciences-evaluation-metrics(RAGAS scores)
