d2v1shx/dazo

Dazo

Dazo is an experimental recurrent latent decision model. It is designed to spend variable test-time compute on structured decisions without generating a natural-language chain of thought.

Dazo is not a pretrained general-purpose checkpoint yet. The initial release is a research architecture and training harness.

Architecture

1. 1.A bidirectional encoder reads the evidence/context.
2. 2.Candidate actions/labels are encoded separately rather than packed into the context sequence.
3. 3.A Perceiver-style cross-attention compressor maps the evidence into a fixed latent workspace.
4. 4.A weight-tied recurrent Transformer repeatedly refines that workspace.
5. 5.Candidate options query the workspace in parallel to produce a calibrated probability distribution.
6. 6.A separate critic predicts correctness/abstention, while recurrent convergence and a learned halt probability provide stopping signals.

The v0 workspace uses evidence, hypothesis, critic, and control slots. The option decoder is permutation-equivariant for categorical decisions; ordinal options carry explicit semantic rank IDs.

Intended research questions

• —Does accuracy increase when Dazo receives more recurrent inference steps on problems requiring deeper composition?
• —Can Dazo generalize from shallow training chains to deeper unseen chains by increasing recurrence at test time?
• —Can adaptive stopping avoid the known recurrent-depth failure mode of overthinking?
• —Does separate option encoding eliminate the high-cardinality and option-order bottlenecks seen in prompt-packed decision models?

Status

Research prototype. Do not treat probabilities as production-calibrated until the model is trained and calibrated on the deployment domain.