khashazad/amc-ruler-qwen35-32k
AMC RULER 32k This dataset contains frozen inputs for the RULER benchmark. Generation metadata Benchmark: RULER Sequence length: 32,768 tokens Tokenizer: Qwen/Qwen3.5-9B Tokenizer revision: c202236 lm-eval version: 0.4.12 Task configurations: 13 Samples per configuration: 500 Deterministic generation: Yes. Each configuration resets Python, NumPy, and task random state to seed 42. Task configurations niah_single_1 niah_single_2 niah_single_3… See the full description on the dataset page: https://huggingface.co/datasets/khashazad/amc-ruler-qwen35-32k.
Document frozen RULER generation metadata
Record frozen RULER dataset identity
Add frozen RULER config ruler_qa_hotpot
Add frozen RULER config ruler_qa_squad
Add frozen RULER config ruler_fwe
Add frozen RULER config ruler_cwe
Add frozen RULER config ruler_vt
Add frozen RULER config niah_multivalue
Add frozen RULER config niah_multiquery
Add frozen RULER config niah_multikey_3
Add frozen RULER config niah_multikey_2
Add frozen RULER config niah_multikey_1
Add frozen RULER config niah_single_3
Add frozen RULER config niah_single_2
Add frozen RULER config niah_single_1
initial commit