datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
AnswerCarefully
AnswerCarefully
概要
AnswerCarefullyは日本語LLM 出力の安全性・適切性に特化したインストラクションデータセットです。
このデータセットは、英語の要注意回答を集めた Do-Not-Answer データセット の包括的なカテゴリ分類に基づき、人手で質問・回答ともに日本語サンプルを集めたオリジナルのデータセットです。
データセットの詳細については、こちらをご覧ください。
Overview
AnswerCarefully is an instruction dataset specifically aimed at ensuring safety and appropriateness of LLM output in Japanese.
This dataset consists of original pairs of questions and reference (safe) responses based on the extensive safety taxonomy proposed in… See the full description on the dataset page: https://huggingface.co/datasets/llm-jp/AnswerCarefully.AnswerCarefully_DPO
AnswerCarefully Translated and Augmented Dataset
This dataset is a preprocessed version of llm-jp/AnswerCarefully, adapted for DPO (Direct Preference Optimization) training.
Dataset Creation Process
Translation: The original llm-jp/AnswerCarefully dataset, which is in English, was translated to Japanese using the Qwen3-32B model.
Rejection Sampling: A rejected response was generated for each question using the Qwen3-14B model. This provides a contrastive pair (chosen vs.… See the full description on the dataset page: https://huggingface.co/datasets/LLMcompe-Team-Watanabe/AnswerCarefully_DPO.AnswerCarefullyanswer_carefully_sft_datasettranslated_answer_carefully_DPOtranslated_answer_carefully_qwen3-32b