Datasetpublic

zjsd/RedStone-Code-python

RedStone Based on the paper "RedStone: Curating General, Code, Math, and QA Data for Large Language Models" and the official GitHub repository, I have replicated the processing of the RedStone-Code (python only) dataset in Redstone. I followed the processing steps outlined in the official repository with minimal modifications. I have not yet used this data for training to verify its quality. The release is under the Redstone's license. If any data within it infringes on your… See the full description on the dataset page: https://huggingface.co/datasets/zjsd/RedStone-Code-python.

sourceHugging Facemitupdated 2y agoView on Hugging Face

8likes910downloads

rootREADME.md

README.md15 linesDownload Raw Back to root

1---2license: mit3language:4- en5---6 7# RedStone8 9Based on the paper "[RedStone: Curating General, Code, Math, and QA Data for Large Language Models](https://arxiv.org/abs/2412.03398)" and the [official GitHub repository](https://github.com/microsoft/RedStone), I have replicated the processing of the **RedStone-Code (python only)** dataset in Redstone.10 11I followed the processing steps outlined in the official repository with minimal modifications.12 13I have not yet used this data for training to verify its quality.14 15The release is under the [Redstone's license](https://github.com/microsoft/RedStone/blob/main/LICENSE). If any data within it infringes on your copyright, please contact me for removal.