datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
cochrane-screening-sft
Cochrane Screening SFT
Supervised fine-tuning (SFT) chat dataset for Cochrane-style title and abstract screening.
Each example is a chat conversation that asks a model to predict a screening decision
(include / exclude / uncertain) and a short justification (reason).
Code: ljwa2323/cochrane-screening-slm
Dataset summary
Split / config
Records
Role
train
416,799
LoRA SFT training
validation
46,311
Training-time validation (10% stratified holdout from… See the full description on the dataset page: https://huggingface.co/datasets/deepcoder2024/cochrane-screening-sft.cochrane_sparse_maxThis is a copy of the Cochrane dataset, except the input source documents of its validation split have been replaced by a sparse retriever. The retrieval pipeline used:
query: The target field of each example
corpus: The union of all documents in the train, validation and test splits. A document is the concatenation of the title and abstract.
retriever: BM25 via PyTerrier with default settings
top-k strategy: "max", i.e. the number of documents retrieved, k, is set as the maximum number of… See the full description on the dataset page: https://huggingface.co/datasets/allenai/cochrane_sparse_max.cochrane_dense_meanThis is a copy of the Cochrane dataset, except the input source documents of its train, validation and test splits have been replaced by a dense retriever. The retrieval pipeline used:
query: The target field of each example
corpus: The union of all documents in the train, validation and test splits. A document is the concatenation of the title and abstract.
retriever: facebook/contriever-msmarco via PyTerrier with default settings
top-k strategy: "max", i.e. the number of documents retrieved… See the full description on the dataset page: https://huggingface.co/datasets/allenai/cochrane_dense_mean.cochrane_combinedCochranePLS_testCochranePLS_1shot_testcochrane_dense_maxThis is a copy of the Cochrane dataset, except the input source documents of its validation split have been replaced by a dense retriever. The retrieval pipeline used:
query: The target field of each example
corpus: The union of all documents in the train, validation and test splits. A document is the concatenation of the title and abstract.
retriever: facebook/contriever-msmarco via PyTerrier with default settings
top-k strategy: "max", i.e. the number of documents retrieved, k, is set as… See the full description on the dataset page: https://huggingface.co/datasets/allenai/cochrane_dense_max.cochrane_dense_oracleThis is a copy of the Cochrane dataset, except the input source documents of the train, validation, and test splits have been replaced by a dense retriever.
query: The target field of each example
corpus: The union of all documents in the train, validation and test splits. A document is the concatenation of the title and abstract.
retriever: facebook/contriever-msmarco via PyTerrier with default settings
top-k strategy: "oracle", i.e. the number of documents retrieved, k, is set as the… See the full description on the dataset page: https://huggingface.co/datasets/allenai/cochrane_dense_oracle.cochrane_sparse_oracleThis is a copy of the Cochrane dataset, except the input source documents of its validation split have been replaced by a sparse retriever. The retrieval pipeline used:
query: The target field of each example
corpus: The union of all documents in the train, validation and test splits. A document is the concatenation of the title and abstract.
retriever: BM25 via PyTerrier with default settings
top-k strategy: "oracle", i.e. the number of documents retrieved, k, is set as the original number… See the full description on the dataset page: https://huggingface.co/datasets/allenai/cochrane_sparse_oracle.CochranePLS_traincochrane_sparse_meanThis is a copy of the Cochrane dataset, except the input source documents of its validation split have been replaced by a sparse retriever. The retrieval pipeline used:
query: The target field of each example
corpus: The union of all documents in the train, validation and test splits. A document is the concatenation of the title and abstract.
retriever: BM25 via PyTerrier with default settings
top-k strategy: "mean", i.e. the number of documents retrieved, k, is set as the mean number of… See the full description on the dataset page: https://huggingface.co/datasets/allenai/cochrane_sparse_mean.