JackHsieh/luna-reason-only.k-8.statml-arxiv-llama32

luna-reason-only.k-8.statml-arxiv-llama32 Prefix-only "thoughts" for next-token prediction on stat.ML arXiv LaTeX. Each thought is visible reasoning about the next 8 Llama-3.2 tokens after a cut, written without ever seeing that continuation. Intended to be spliced into the document before the chunk so a small model (Llama 3.2 3B base) can read the reasoning and predict the chunk. Complete: every designated chunk has a thought. split thoughts coverage documents… See the full description on the dataset page: https://huggingface.co/datasets/JackHsieh/luna-reason-only.k-8.statml-arxiv-llama32.