typed-decisions
typed-decisions
Typed Decisions
A benchmark for typed probabilistic decisions over shared state. You give a
model one piece of unstructured state. It answers several typed questions about
that state at once, and every answer is a probability distribution rather than a
single label.
The schema follows the System One primitives used by
TypeSafe AI: noul, choice and score. A row replays against any API that implements that shape. This benchmark is
independent. It is not affiliated with TypeSafe… See the full description on the dataset page: https://huggingface.co/datasets/LocalLLaMA/typed-decisions.typed-decisions-causal-experimenttyped-decisions-v2
typed-decisions-v2
Corrected companion corpus to pngwn/typed-decisions
(the "v1" corpus) for the typed-decision baselines. v2 repairs the
synthetic-domain label/oracle inversion that was disclosed but not fixed in v1
(nanodiff REPORT.md, finding 6) and adds a raw-text dump so that any tokenizer
(GPT-2 and Qwen) can consume byte-identical examples.
The fix
Both defects live in the synthetic ticket-triage generator (code/build_dataset_v2.py,
applied to the v1… See the full description on the dataset page: https://huggingface.co/datasets/pngwn/typed-decisions-v2.typed-decisions
typed-decisions
A typed-decision corpus for training a masked-diffusion LM to emit calibrated
discrete decisions instead of text. Built for fine-tuning
Sebasdi/nanodiff-350m-base
(the LLaDA recipe).
The interface
Every example is a prompt plus a response, and every decision is a single
masked token. The answer is always one option letter A-J:
### State:
<unstructured state text>
### Question:
<the decision to make>
### Options:
A) yes
B) no
### Answer:
A
The… See the full description on the dataset page: https://huggingface.co/datasets/pngwn/typed-decisions.typed-decisions-v2-system-onetyped-decisions-code-holes
typed-decisions: code-holes
Single-token substitutions mined from the git history of 64 public repositories in the
kotoba-lang organisation, each turned into one choice question
with a gold answer: the token the commit actually put there. Part of
kotoba-lang/typed-decisions (README 第8反復),
whose trained model is com-kotobalabs/open-jev-deberta-v3-large.
Sibling dataset (ungoaled): com-kotobalabs/typed-decisions-repo-governance.
What a record is
state = the commit… See the full description on the dataset page: https://huggingface.co/datasets/com-kotobalabs/typed-decisions-code-holes.