Laurent1/MedQuad-MedicalQnADataset_128tokens_max
Reference : "A Question-Entailment Approach to Question Answering". Asma Ben Abacha and Dina Demner-Fushman. BMC Bioinformatics, 2019." This is an update of Keivalya Pandya's dataset (keivalya/MedQuad-MedicalQnADataset). Content There are medical questions and corresponding responses in a prompt format for chat or instruct model types In order to fine tuned LLM with small HW (1 or 2 GPU with 14 Go) Rows above 128 tokens have been deleted. Rows have been truncated to a line break or a… See the full description on the dataset page: https://huggingface.co/datasets/Laurent1/MedQuad-MedicalQnADataset_128tokens_max.
Reference : "A Question-Entailment Approach to Question Answering". Asma Ben Abacha and Dina Demner-Fushman. BMC Bioinformatics, 2019." <br/>This is an update of Keivalya Pandya's dataset (keivalya/MedQuad-MedicalQnADataset).
<h1> Content </h1> There are medical questions and corresponding responses in a prompt format for chat or instruct model types <br/>In order to fine tuned LLM with small HW (1 or 2 GPU with 14 Go) <br/>Rows above 128 tokens have been deleted. <br/>Rows have been truncated to a line break or a sentence end in order to keep a correct meaning
<h2> Script to download the dataset </h2> <br/>from datasets import loaddataset <br/>datasetname = "Laurent1/MedQuad-MedicalQnADataset128tokensmax" <br/>dataset = loaddataset(datasetname, split="train")