Datasetpublic

KeisukeMiyamoto/SyntheticTextbook-jp

SyntheticTextbook-jp SyntheticTextbook-jp is a Japanese synthetic text dataset generated with Gemma 4 26B and Gemma 4 31B. The dataset was created by rewriting noisy source text into textbook-style Japanese for elementary school, junior high school, and high school levels. The rewritten text keeps only general knowledge from the source text. Purpose The main purpose of this dataset is to help LLMs learn natural Japanese text flow. This dataset is designed around… See the full description on the dataset page: https://huggingface.co/datasets/KeisukeMiyamoto/SyntheticTextbook-jp.

sourceHugging Faceapache-2.0updated 1mo agoView on Hugging Face

0likes150downloads

Dataset Card

SyntheticTextbook-jp

SyntheticTextbook-jp is a Japanese synthetic text dataset generated with Gemma 4 26B and Gemma 4 31B. The dataset was created by rewriting noisy source text into textbook-style Japanese for elementary school, junior high school, and high school levels. The rewritten text keeps only general knowledge from the source text.

Purpose

The main purpose of this dataset is to help LLMs learn natural Japanese text flow. This dataset is designed around topics that an average Japanese student may learn in school classes.

Source Data

The source text comes from: https://huggingface.co/datasets/hotchpotch/fineweb-2-edu-japanese

Dataset Size

Split	Rows	Output tokens
Train	1,067,212	974.0M
Validation	10,889	10.0M
Test	10,889	10.0M
Total	1,088,990	993.9M

Rows were shuffled with seed 42 before the 98% train, 1% validation, and 1% test split. Token counts were measured with the Gemma 4 tokenizer.

Columns

Column	Description
`source_id`	ID of the source text.
`url`	URL from the source dataset.
`source_text`	Original noisy source text.
`prompt_type`	Target school level: `elementary-school`, `junior-high-school`, or `high-school`.
`prompt`	Input text used for rewriting.
`rewrite`	Synthetic textbook-style Japanese text.
`output_tokens`	Number of tokens in `rewrite`.
`output_chars`	Number of characters in `rewrite`.

Example

python

from datasets import load_dataset

dataset = load_dataset("MK0727/SyntheticTextbook-jp", split="train")
print(dataset[0]["rewrite"])

Notes

The prompts were designed carefully, but the dataset may still include hallucinations generated by Gemma 4.

Support Lambda

Lambda is an open-source project for building small Japanese language models from scratch. As a student, I have funded this project with income from my part-time job, but the growing training costs are becoming difficult to cover.

Your support helps cover GPU costs and develop larger models. Thank you for helping Lambda continue to grow.

Vast.ai

Vast.ai offers affordable cloud GPUs for AI training, with NVIDIA H100 SXM GPUs available from around $1.54 per hour. If you purchase credits through the link below, I receive 3% in GPU credits at no extra cost to you.

https://cloud.vast.ai/?ref_id=521936

Ko-fi

Support Lambda with a donation starting from $5.