datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
KMMLU-Pro
KMMLU-Pro
📄 Paper | 🖥️ Code
We introduce KMMLU-PRO, a challenging new benchmark comprising 2,822 problems from the official exams for Korean National Professional Licensure (KNPL), representing highly specialized professions in Korea. To bridge the gap between LLM performance and real-world applicability, our evaluation closely mirrors the official certification criteria including reporting the number of professional licenses each LLM could pass according to these standards. All… See the full description on the dataset page: https://huggingface.co/datasets/LGAI-EXAONE/KMMLU-Pro.KMMLU-Redux
KMMLU-Redux
📄 Paper
We introduce KMMLU-Redux, a reconstructed version of the existing KMMLU, comprising 2,587 problems from Korean National Technical Qualification (KNTQ) exams. We identified several critical issues in the KMMLU, including leaked answers, lack of clarity, ill-posed questions, notation errors, and contamination risks. To address these problems, we conducted rigorous manual examination and decontaminated the dataset from the pre-training corpus to prevent potential… See the full description on the dataset page: https://huggingface.co/datasets/LGAI-EXAONE/KMMLU-Redux.kmmlukmmlu-conversation-sampleKmmlu 데이터를 이용해서 대화 데이터셋 샘픔을 생성하였습니다.
멀티턴 데이터셋으로 학습용도로 만들어졌습니다.