SII-LancelotXie/DRIFT_LFRP

DRIFT_LFRP DRIFT_LFRP is a curriculum-style dataset constructed from the English Wikipedia snapshot dated November 1, 2023. The source dataset is released by Wikimedia on Hugging Face: https://huggingface.co/datasets/wikimedia/wikipedia The original data comes from Wikipedia snapshots provided by Wikimedia. Each example corresponds to a cleaned Wikipedia entry segment.The dataset is organized by token-length intervals, where token counts are computed using Qwen2Tokenizer.… See the full description on the dataset page: https://huggingface.co/datasets/SII-LancelotXie/DRIFT_LFRP.