CoolFace
Datasetpublic

mzio/aprm-sft-thoughts-tau2-airline-base_best-adamw30-lp0

Act-PRM SFT thoughts — tau2-bench airline Act-PRM (Action Process Reward Models) infers the latent thoughts behind logged, action-only agent demonstrations via an offline EM. For each logged action x in state s we sample G=4 candidate thoughts z, score each by the length-penalized action likelihood reward(z) = p(x | s, z) (len_frac grows with the thought's token length), and mark the best thought (argmax reward). The (thought + action) span is then what downstream SFT / RL… See the full description on the dataset page: https://huggingface.co/datasets/mzio/aprm-sft-thoughts-tau2-airline-base_best-adamw30-lp0.

sourceHugging Facemitupdated 22d agoView on Hugging Face
0likes51downloads
discussions and pull requests

Conversations for this repository live on Hugging Face.

CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.

Open discussions on Hugging Face
mzio/aprm-sft-thoughts-tau2-airline-base_best-adamw30-lp0 · CoolFace