text-machine-lab/constrained_language

Dataset Card for constrained_language (pre-training data for simplified English) Dataset Summary This dataset is one of the two datasets published by "Honey, I Shrunk the Language: Language Model Behavior at Reduced Scale" (https://arxiv.org/abs/2305.17266). The dataset available at this link is the pre-training data constrained by vocabulary. The other published data i.e. the pre-training data that is not constrained by vocabulary is available at… See the full description on the dataset page: https://huggingface.co/datasets/text-machine-lab/constrained_language.