Datasetpublic

ryansubq/ruler-12m-niah-external

RULER-12M NIAH Eval — external handoff 50 × single_needle_uuid samples at ~12 M tokens per sample. One of four length variants (1 M / 2 M / 6 M / 12 M) prepared for the external long-context retrieval handoff. field value samples 50 tasks {single_needle_uuid: 50} target tokens 12,000,000 seed 1344 negative_rate 0.0 eval/heldout/data.jsonl is the chat-templated form, ready for model.forward(); eval/heldout/raw.jsonl is the pre-template form… See the full description on the dataset page: https://huggingface.co/datasets/ryansubq/ruler-12m-niah-external.

sourceHugging Faceotherupdated 3mo agoView on Hugging Face

0likes29downloads

Dataset Card

RULER-12M NIAH Eval — external handoff

50 × single_needle_uuid samples at ~12 M tokens per sample. One of four length variants (1 M / 2 M / 6 M / 12 M) prepared for the external long-context retrieval handoff.

field	value
samples	50
tasks	`{single_needle_uuid: 50}`
target tokens	12,000,000
seed	1344
negative_rate	0.0

eval/heldout/data.jsonl is the chat-templated form, ready for model.forward(); eval/heldout/raw.jsonl is the pre-template form (tokenizer-agnostic — re-pack with subq-data ruler-pack against any target tokenizer).