domofon/structured-cpt
Structured CPT - JSON + SQL pretrain documents SmolLM2-1.7B continued-pretraining shard of structured documents. Each document is a <task> / <input> / <output> block whose <output> is a canonical JSON object, terminated by the SmolLM2 end-of-text token ``. Sources: source description rows shards repeat sql_bmc2 b-mc2 sql-create-context -> JSON (4 keys, stub explanation) 392,885 1 5 sql_gretelai gretelai synthetic_text_to_sql -> JSON (4 keys) 529,255 1 5… See the full description on the dataset page: https://huggingface.co/datasets/domofon/structured-cpt.
Structured CPT - JSON + SQL pretrain documents
SmolLM2-1.7B continued-pretraining shard of structured documents. Each document is a <task> / <input> / <output> block whose <output> is a canonical JSON object, terminated by the SmolLM2 end-of-text token ``.
Sources:
Totals: 7,258,140 rows.
from datasets import load_dataset
ds = load_dataset("domofon/structured-cpt", split="train")
print(ds[0]["text"])Document shape
<task>
...
</task>
<input>
...
</input>
<output>
{...canonical json...}
</output>
The JSON inside <output> keeps the documented key order and exact (JSON-escaped) source values. SQL values are copied verbatim from the input.
Columns
Shards
35 parquet files under data/ (zstd-compressed).
Identity
Built for the Domofon CPT stack; see sibling datasets domofon/worldsim-domofon-cpt and domofon/domofon-identity-anchor.