kellyhongg/niah-multi-distractors
Needle in a Haystack with Multiple Distractors This dataset extends the original Needle in a Haystack (NIAH) benchmark by introducing distractors alongside the original needle-question setup. The haystack passages are drawn from the Paul Graham essays and arXiv papers. Questions, needles, and distractors are manually written. This Needle in a Haystack setup was used in Context Rot.
013
Needle in a Haystack with Multiple Distractors
This dataset extends the original Needle in a Haystack (NIAH) benchmark by introducing distractors alongside the original needle-question setup.
The haystack passages are drawn from the Paul Graham essays and arXiv papers. Questions, needles, and distractors are manually written.
This Needle in a Haystack setup was used in Context Rot.