tf-tpu/wikitext-v1-tfrecords

This dataset repository contains the TFRecord shards of the [WikText (v1) dataset](https://huggingface.co/datasets/wikitext. We used this script to prepare these TFRecord shards. For more details on how these TFRecord shards should be used, refer to the following tutorial: Training a masked language model end-to-end from scratch on TPUs .