DMIS
Datasets
All datasets matching “DMIS”meerkat-instructionsThis repository provides the instruction tuning data used to train our medical language model, Meerkat, along with descriptions.
For more information, please refer to the paper below. Our models can be downloaded from the official model repository.
📄 Paper: Small Language Models Learn Enhanced Reasoning Skills from Medical Textbooks
Dataset Statistics
Table: Statistics of our instruction-tuning datasets“# Examples” denotes the number of training examples for each dataset.
†… See the full description on the dataset page: https://huggingface.co/datasets/dmis-lab/meerkat-instructions.oc20-s2ef-uma-embeddingsMedLFQAOriginal dataset introduced by Jeong et al. in OLAPH: Improving Factuality in Biomedical Long-form Question Answering
Citation information:
@misc{jeong2024olaph,
title={OLAPH: Improving Factuality in Biomedical Long-form Question Answering},
author={Minbyul Jeong and Hyeon Hwang and Chanwoong Yoon and Taewhoo Lee and Jaewoo Kang},
year={2024},
eprint={2405.12701},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
ChroKnowBench
ChroKnowBench
ChroKnowBench is a benchmark dataset designed to evaluate the performance of language models on temporal knowledge across multiple domains. The dataset consists of both time-variant and time-invariant knowledge, providing a comprehensive assessment for understanding knowledge evolution and constancy over time.
Dataset is introduced by Park et al. in ChroKnowledge: Unveiling Chronological Knowledge of Language Models in Multiple Domains
Dataset Overview… See the full description on the dataset page: https://huggingface.co/datasets/dmis-lab/ChroKnowBench.llama-3.1-medprm-reward-training-set
Med-PRM-Reward (Version 1.0)
🚀 Med-PRM-Reward is among the first Process Reward Models (PRMs) specifically designed for the medical domain. Unlike conventional PRMs, it enhances its verification capabilities by integrating clinical knowledge through retrieval-augmented generation (RAG). Med-PRM-Reward demonstrates exceptional performance in scaling-test-time computation, particularly outperforming majority‐voting ensembles on complex medical reasoning tasks. Moreover, its… See the full description on the dataset page: https://huggingface.co/datasets/dmis-lab/llama-3.1-medprm-reward-training-set.RF-Collection
RF_Collection
Dataset Description
We construct a large-scale dataset called RF-Collection, containing Retrievers' Feedback on oer 410k query rewrites across 12K conversations.
Dataset Files
The dataset is organized into several CSV files, each corresponding to different retrieval and datasets:
TopiOCQA_train_bm25.csv: Contains the retrieval results using the BM25 on the TopiOCQA dataset.
TopiOCQA_train_ance.csv: Contains the retrieval results using the ANCE on… See the full description on the dataset page: https://huggingface.co/datasets/dmis-lab/RF-Collection.