KevinDavidHayes/long-context-baseline-bakeoff

Long-Context Data-Selection Bake-off — Shared Candidate Pool The shared 16K candidate pool for comparing long-context data-selection methods on equal footing. Every method (AttentionSpan, LongAttn, LongProc, ProLong, perplexity, ...) scores the same 14,300 documents, picks its own top-800 under the same split, then trains Llama-2-7B + 16K LoRA and evaluates on HELMET. Files File Description candidate_pool_16k_scored.parquet The shared pool — 14,300 docs… See the full description on the dataset page: https://huggingface.co/datasets/KevinDavidHayes/long-context-baseline-bakeoff.