datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
hintedselfteacher-nemotron-math-v2-AoPS
hintedselfteacher-nemotron-math-v2-AoPS
This dataset contains a training-ready hinted self-teacher split derived from the AoPS split of nvidia/Nemotron-Math-v2.
The source problems were filtered to the AoPS split with the medium/notool solve rate between 2 and 6. Hints were generated with GPT-5.5 medium using an h17_nt hint-generation prompt. This hint type was close to the best hint type found after doing hint mutations, based on qualitative analysis of token-level hinted… See the full description on the dataset page: https://huggingface.co/datasets/ar0cket1/hintedselfteacher-nemotron-math-v2-AoPS.mmlu_hinted_questions
MMLU Hinted Questions
Dataset Description
This dataset contains multiple-choice questions derived from MMLU and augmented with misleading hints. The misleading hints are intentionally designed to point to an incorrect answer.
The dataset was developed as part of the UnfaithRL project, which studies cue-following and unfaithful reasoning under reinforcement learning with verifiable rewards.
Specifically, it was used to investigate whether language models follow… See the full description on the dataset page: https://huggingface.co/datasets/UnfaithRL/mmlu_hinted_questions.mmlu_hinted_rollouts
MMLU-with-hint faithfulness eval — flipped-to-hint rollouts (+ judge verdicts)
Companion data for the blog post on side effects of CoT length penalties in RL
(MATS sprint project). Model checkpoints:
brikdavies/RL-length-penalty-checkpoints.
Each row is one MMLU question (~5k question eval, hint placed mid-prompt) where the
model flipped its answer to the hinted answer (unhinted_answer != hinted_answer
and the hinted run's extracted answer equals the hint). Rows carry:
the… See the full description on the dataset page: https://huggingface.co/datasets/lucferon/mmlu_hinted_rollouts.cot-oracle-eval-hinted-mcq-truthfulqaevals__lmfd__hinted_method__gpt4omini__samplesevals__full_TAUR_dev__convos__lmfd__hinted_method__gpt4omini__samples