simplestories
SimpleStories
📘📕 SimpleStories 📙📗
SimpleStories is a dataset of >2 million model-generated short stories. It was made to train small, interpretable language models on it. The generation process is open-source: To see how the dataset was generated, or to generate some stories yourself, head over to this repository.
If you'd like to commission other languages or story formats, feel free to send mail.
When using SimpleStories in your work, please cite the SimpleStories paper:… See the full description on the dataset page: https://huggingface.co/datasets/SimpleStories/SimpleStories.SimpleStories-JA
📘📕 SimpleStories 📙📗
このデータセットは、gpt-4o-miniによって生成された短編小説で出来ているデータセットです。生成方法や、自分で物語を生成する方法については、こちらのリポジトリをご覧ください。
他の言語や物語形式の制作を希望される場合は、メールにてお問い合わせください。
SimpleStoriesは、EldenとLiによるTinyStoriesの改良版です。
特徴
物語の注釈情報（theme、topic、styleなど）
多様性の高さ
2024年のモデルによって生成
NLPのデータが用意しているためフィルタリングしやすい
以下の言語版が利用可能：
英語
日本語
他にも追加予定
This dataset is a collection of short stories generated by gpt-4o-mini (+ other models, soon). To see how this dataset was generated, or to generate some stories… See the full description on the dataset page: https://huggingface.co/datasets/SimpleStories/SimpleStories-JA.SimpleStories
📘📕 SimpleStories 📙📗
SimpleStories is a dataset of >2 million model-generated short stories. It was made to train small, interpretable language models on it. The generation process is open-source: To see how the dataset was generated, or to generate some stories yourself, head over to this repository.
If you'd like to commission other languages or story formats, feel free to send mail.
When using SimpleStories in your work, please cite the SimpleStories paper:… See the full description on the dataset page: https://huggingface.co/datasets/duoduoyeah/SimpleStories.simplestories-8k-megatron📦 Megatron-LM/MegaDLMs Preprocessed Dataset
This dataset hosts the Megatron-LM/MegaDLMs preprocessed SimpleStories dataset using an 8k vocab BPE Tokenizer.
✅ What this contains
Preprocessed Megatron dataset files (e.g., .bin / .idx) ready for Megatron-LM/MegaDLMs training
BPE Tokenizer config files used to create the dataset
🔗 References
Fork with extra preprocessing utils for SimpleStories:
https://github.com/triloy8/MegaDLMs
Original MegaDLMs repo:… See the full description on the dataset page: https://huggingface.co/datasets/trixyL/simplestories-8k-megatron.rjarxiv_starcoder_simplestories_1Bthis contains around 1B tokens of text data from three subsets : redpajama/arxiv (21k samples), starcoder (210k samples) & simplestories (1M samples)
simplestories-ja-en-endings
Dataset Card for SimpleStories-JA-EN-Endings
I translated the endings of all the stories in SimpleStories-JA into English using Claude 3.5 Haiku.
There was over a 99% success rate so the number of stories in here is just slightly less than the number in SimpleStories-JA.
Dataset Details
Dataset Sources
SimpleStories/SimpleStories-JA