mzio/aprm-sft-thoughts-tau2-airline-policy_best-adamw30-lp0

Act-PRM SFT thoughts — tau2-bench airline Act-PRM (Action Process Reward Models) infers the latent thoughts behind logged, action-only agent demonstrations via an offline EM. For each logged action x in state s we sample G=4 candidate thoughts z, score each by the length-penalized action likelihood reward(z) = p(x | s, z) (len_frac grows with the thought's token length), and mark the best thought (argmax reward). The (thought + action) span is then what downstream SFT / RL… See the full description on the dataset page: https://huggingface.co/datasets/mzio/aprm-sft-thoughts-tau2-airline-policy_best-adamw30-lp0.