caskcsg/NExtLong-128K-dataset

NExtLong: Toward Effective Long-Context Training without Long Documents This repository contains the code ,models and datasets for our paper NExtLong: Toward Effective Long-Context Training without Long Documents. [Github] Quick Links Overview NExtLong Models NExtLong Datasets Datasets list How to use NExtLong datasets Bugs or Questions? Overview Large language models (LLMs) with extended context windows have made significant strides yet remain… See the full description on the dataset page: https://huggingface.co/datasets/caskcsg/NExtLong-128K-dataset.