datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
answercarefully-dpo-ja-2026
AnswerCarefully-derived Japanese DPO data for LLM safety
本データセットは、llm-jp/AnswerCarefullyを参照して作成した日本語LLMの安全応答をDPOで学習するためのpreference datasetです。
利用条件
本データセットには、llm-jp/AnswerCarefullyと同じ利用規約を適用します。
利用者は、llm-jp/AnswerCarefullyと本データセットの両方で利用規約に同意する必要があります。
データ
train: 417件
validation: 44件
各行には次のフィールドが含まれます。
id: 本リリース内だけで使用するID
prompt: 元質問の意味と危険性を変えずに言い換えた質問
chosen: DPOで望ましい応答として扱う回答
rejected: DPOで望ましくない応答として扱う回答
category, harm_type, risk_area… See the full description on the dataset page: https://huggingface.co/datasets/ekunish/answercarefully-dpo-ja-2026.do-not-answer
Do-Not-Answer: A Dataset for Evaluating Safeguards in LLMs
Overview
Do not answer is an open-source dataset to evaluate LLMs' safety mechanism at a low cost. The dataset is curated and filtered to consist only of prompts to which responsible language models do not answer.
Besides human annotations, Do not answer also implements model-based evaluation, where a 600M fine-tuned BERT-like evaluator achieves comparable results with human and GPT-4.
Instruction… See the full description on the dataset page: https://huggingface.co/datasets/LibrAI/do-not-answer.NLU-Question-Answering
SEA Question Answering
SEA Question Answering evaluates a model's ability to predict a contiguous span of characters that answers the question about a given passage. It is sampled from TyDi QA-GoldP for Indonesian, IndicQA for Tamil, and XQuaD for Thai and Vietnamese.
Supported Tasks and Leaderboards
SEA Question Answering is designed for evaluating chat or instruction-tuned large language models (LLMs). It is part of the SEA-HELM leaderboard from AI Singapore.… See the full description on the dataset page: https://huggingface.co/datasets/aisingapore/NLU-Question-Answering.task453_swag_answer_generation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task453_swag_answer_generation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task453_swag_answer_generation.task067_abductivenli_answer_generation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task067_abductivenli_answer_generation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task067_abductivenli_answer_generation.answers-with-reasoning-mmlu-pro
answers-with-reasoning-mmlu-pro
Self-distillation SFT corpus: Qwen3-8B-Instruct's own correct
chain-of-thought rollouts on MMLU-Pro multiple-choice questions
(general-QA domain).
Generation
Source problems: TIGER-Lab/MMLU-Pro test split (12,032 multiple-choice questions across 14 subject categories).
Sampling model: qwen/qwen3-8b via OpenRouter (providers: Alibaba, AtlasCloud) with reasoning enabled.
Sampling parameters: temperature=0.6, top_p=0.95, max_tokens=8000.… See the full description on the dataset page: https://huggingface.co/datasets/abhayesian/answers-with-reasoning-mmlu-pro.task620_ohsumed_medical_subject_headings_answer_generation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task620_ohsumed_medical_subject_headings_answer_generation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task620_ohsumed_medical_subject_headings_answer_generation.task454_swag_incorrect_answer_generation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task454_swag_incorrect_answer_generation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task454_swag_incorrect_answer_generation.task1518_limit_answer_generation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task1518_limit_answer_generation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task1518_limit_answer_generation.task330_gap_answer_generation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task330_gap_answer_generation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task330_gap_answer_generation.task683_online_privacy_policy_text_purpose_answer_generation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task683_online_privacy_policy_text_purpose_answer_generation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task683_online_privacy_policy_text_purpose_answer_generation.task580_socialiqa_answer_generation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task580_socialiqa_answer_generation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task580_socialiqa_answer_generation.whittle-teacher32-complete-answers
Whittle teacher32: complete answers with per-token teacher logprobs
Research preview. Part of the Whittle compression campaign, a personal
research project. The compute for this project is self funded and donations
decide whether the next round happens: https://ko-fi.com/davida81328
What this is
Complete answers generated by Qwen3.8-27B (UD-Q5_K_XL via llama.cpp), each
ending on a real end-of-turn token because the answer is finished, with the
teacher's top-32… See the full description on the dataset page: https://huggingface.co/datasets/logic65/whittle-teacher32-complete-answers.task720_mmmlu_answer_generation_marketing
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task720_mmmlu_answer_generation_marketing
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task720_mmmlu_answer_generation_marketing.task081_piqa_wrong_answer_generation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task081_piqa_wrong_answer_generation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task081_piqa_wrong_answer_generation.task742_lhoestq_answer_generation_frequency
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task742_lhoestq_answer_generation_frequency
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task742_lhoestq_answer_generation_frequency.task717_mmmlu_answer_generation_logical_fallacies
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task717_mmmlu_answer_generation_logical_fallacies
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task717_mmmlu_answer_generation_logical_fallacies.task722_mmmlu_answer_generation_random_topic
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task722_mmmlu_answer_generation_random_topic
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task722_mmmlu_answer_generation_random_topic.task080_piqa_answer_generation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task080_piqa_answer_generation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task080_piqa_answer_generation.task068_abductivenli_incorrect_answer_generation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task068_abductivenli_incorrect_answer_generation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task068_abductivenli_incorrect_answer_generation.text-sft-questions-answers-only
text-sft: Questions and Answers
This dataset consists of question-and-answer pairs generated from short excerpts drawn from Wikipedia, Cosmopedia, and FineWeb-Edu. It is an adapted version of agentlans/text-sft.
Overview
The dataset provides compact examples of English question-and-answer relationships that can help models learn linguistic patterns, syntactic structures, and semantic associations between questions and their corresponding answers.
Intended Use… See the full description on the dataset page: https://huggingface.co/datasets/agentlans/text-sft-questions-answers-only.task705_mmmlu_answer_generation_high_school_macroeconomics
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task705_mmmlu_answer_generation_high_school_macroeconomics
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task705_mmmlu_answer_generation_high_school_macroeconomics.task072_abductivenli_answer_generation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task072_abductivenli_answer_generation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task072_abductivenli_answer_generation.task1592_yahoo_answers_topics_classfication
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task1592_yahoo_answers_topics_classfication
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task1592_yahoo_answers_topics_classfication.task083_babi_t1_single_supporting_fact_answer_generation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task083_babi_t1_single_supporting_fact_answer_generation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task083_babi_t1_single_supporting_fact_answer_generation.task865_mawps_addsub_question_answering
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task865_mawps_addsub_question_answering
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task865_mawps_addsub_question_answering.task728_mmmlu_answer_generation_professional_accounting
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task728_mmmlu_answer_generation_professional_accounting
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task728_mmmlu_answer_generation_professional_accounting.task861_asdiv_addsub_question_answering
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task861_asdiv_addsub_question_answering
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task861_asdiv_addsub_question_answering.task307_jeopardy_answer_generation_final
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task307_jeopardy_answer_generation_final
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task307_jeopardy_answer_generation_final.task196_sentiment140_answer_generation
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task196_sentiment140_answer_generation
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task196_sentiment140_answer_generation.