datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
ctmatch_irCTMatch Information Retrieval Dataset
This is a dataset of processed clinical trials documents, somehwat of a duplication of that found in datasets/ir_datasets
except that these have been preprocessed with ctproc to clean and extract useful fields from the clinical trial documents.
Note: They are currently saved as text files because of the downstream task in ctmatch, though in the future they may be converted to .csv.
Each .txt file has exactly 374648 lines of corresponding data:… See the full description on the dataset page: https://huggingface.co/datasets/semaj83/ctmatch_ir.ctmatch_classificationCTMatch Classification Dataset
This is a combined set of 2 labelled datasets of:
topic (patient descriptions), doc (clinical trials documents - selected fields), and label ({0, 1, 2}) triples, in jsonl format.
(Somewhat of a duplication of some of the ir_dataset also available on HF.)
These have been processed using ctproc, and in this state can be used by various tokenizers for fine-tuning (see ctmatch for examples).
These 2 datasets contain no patient identifying information are openly… See the full description on the dataset page: https://huggingface.co/datasets/semaj83/ctmatch_classification.ctms-multitask-sft-v6
CTMS Multi-task SFT — V6
A matched pair of corpora for a clinical-trial-management text-to-SQL agent, differing in
exactly one variable: whether generate_sql rows carry a <think> reasoning trace.
run_a (control)
run_b (traced)
total
23,049
23,049
train / val / test
18,698 / 2,172 / 2,179
18,698 / 2,172 / 2,179
traced train SQL rows
0
10,125 (81.0%)
gold SQL
identical, byte-for-byte
identical, byte-for-byte
Tasks
task
n… See the full description on the dataset page: https://huggingface.co/datasets/persistent-fm/ctms-multitask-sft-v6.CT_med
Contains:
TRIAL NAME
BRIEF
DRUG USED
DRUG CLASS
INDICATION
TARGET
THERAPY
LEAD SPONSOR
CT-MRI_metrics_validation_datasetctms-multitask-sft-v3
CTMS Multi-Task SFT — V3 (uppercase-Snowflake)
Supervised fine-tuning corpus for a Clinical Trial Management System (CTMS) analytics assistant, spanning
7 tasks over a 122-table CTMS schema. This is the V3 build: all SQL uses unquoted identifiers
that resolve against the uppercase-identifier Snowflake schema DUMMY_FORTREA_AI_MODEL.FORTREA_AI_MODEL_V3_CAP.
Data is fully synthetic (generated from a CTMS data generator). It contains no real patient,
investigator, or trial data.… See the full description on the dataset page: https://huggingface.co/datasets/persistent-fm/ctms-multitask-sft-v3.ctms-multitask-sft-v10-2