CoolFace
Datasetpublic

caiotheodoro/suture

Suture Gold tasks for policy-issuance QC: a structured underwriting binder, a structured issued policy, and the exact discrepancy set. Images are not stored. Re-render with suture_forge.generate.render_doc from the GitHub repo. Paper and adapter: caiotheodoro/suture · caiotheodoro/suture-8b. Predictions on this gold: caiotheodoro/suture-evals. Splits Config Seed n What benchmark 777 1000 Contracted held-out set. Never in train. validation 7 holdout 80… See the full description on the dataset page: https://huggingface.co/datasets/caiotheodoro/suture.

sourceHugging Faceapache-2.0updated 1mo agoView on Hugging Face
0likes72downloads
Dataset Card

Suture

Gold tasks for policy-issuance QC: a structured underwriting binder, a structured issued policy, and the exact discrepancy set. Images are not stored. Re-render with suture_forge.generate.render_doc from the GitHub repo.

Paper and adapter: caiotheodoro/suture · `caiotheodoro/suture-8b`. Predictions on this gold: `caiotheodoro/suture-evals`.

Splits

ConfigSeednWhat
benchmark7771000Contracted held-out set. Never in train.
validation7 holdout80Val. Optimistic vs 777; DEDUCTIBLE_HIGHER gold n=0.
train7+11+13+17+19+235120Published SFT mix (train_dedhi).
train_seed77320Official stratified split, no class boost.

Leakprobe vs val and vs benchmark is 0. Signature = SHA-256 over sorted ground-truth fields. Build refuses overlap > 0.

Row schema

Each line is a Task: task_id, seed, binder, policy, image_*_sha256, expected (PASS/FLAG + discrepancies), signature, difficulty. Taxonomy and weights: repo CONTRACTS.md (13 classes).

Render

python
from datasets import load_dataset
from suture_forge.schema import Binder, Policy
from suture_forge.generate import render_doc

row = load_dataset("caiotheodoro/suture", "benchmark", split="train")[0]
png = render_doc(Binder.model_validate(row["binder"]), "BINDER",
                 row["difficulty"], row["task_id"])

Linux vs macOS raster can differ (SHA mismatch). Labels do not. Eval in the project re-renders on the GPU host.

License / use

Apache-2.0. Synthetic ACORD-style pages, not real submissions. Form numbers are public ISO ids. Do not treat this as a carrier document corpus.