limberc/this-that-complex-decisions
this-that-complex-decisions 1,710 decisions where the answer follows from a stated policy applied to a state, and where no single field of that state gives it away. 1,710 questions 19 decision types 40 domains chance rate 0.258 Each row is a state, a question, a closed set of options, and the index of the one option the policy selects. The answer is determinate: given the state and the policy there is exactly one correct choice, and it does not depend on anyone's… See the full description on the dataset page: https://huggingface.co/datasets/limberc/this-that-complex-decisions.
Five figures: the latency frontier, the per-type matrix, knapsack, the advantage chart, and cost
All nine systems on all 1,710 questions; per-family results and figures
1,710 decisions that a rules engine cannot make: 19 rule structures, 40 domains, three gates
initial commit