jonathan-roberts1/needle-threading

Needle Threading: Can LLMs Follow Threads through Near-Million-Scale Haystacks? Dataset Summary As the context limits of Large Language Models (LLMs) increase, the range of possible applications and downstream functions broadens. Although the development of longer context models has seen rapid gains recently, our understanding of how effectively they use their context has not kept pace. To address this, we conduct a set of retrieval experiments designed to… See the full description on the dataset page: https://huggingface.co/datasets/jonathan-roberts1/needle-threading.