Datasetpublic

mzio/aprm-sft_thinkact-Eaprm_tw_tr_easy_gpt5m-Gaprm_qwen3_ap-S0-Rgpt5m_0-ap1-train_all-b040

Act-PRM Rollout Dataset Run Metadata run_name: act-prm-v2-ia=0-rr=0-ec=act_prm_tw_treasure_easy_gpt5m-gc=aprm_qwen3_ap-tc=aprm_for_sft100-rbc=default-mc=hf_qwen3_4b_inst_2507-lc=r8_a16_qkvo-nf=1-ao=1-ho=1-gs=8-bs=8-lr=4e_05-ns=4-s=0-r=gpt5m_0 run_cmd: main_pytorch.py --env_config act_prm/tw_treasure_easy_gpt5m --model_config hf_qwen3_4b_inst_2507 --lora_config r8_a16_qkvo --replay_buffer_config default --log_path ./logs --no_fa2 --generator_config aprm_qwen3_ap… See the full description on the dataset page: https://huggingface.co/datasets/mzio/aprm-sft_thinkact-Eaprm_tw_tr_easy_gpt5m-Gaprm_qwen3_ap-S0-Rgpt5m_0-ap1-train_all-b040.

sourceHugging Faceupdated 6mo agoView on Hugging Face

0likes7downloads

Dataset Card

Act-PRM Rollout Dataset

Run Metadata

—run_name: act-prm-v2-ia=0-rr=0-ec=act_prm_tw_treasure_easy_gpt5m-gc=aprm_qwen3_ap-tc=aprm_for_sft100-rbc=default-mc=hf_qwen3_4b_inst_2507-lc=r8_a16_qkvo-nf=1-ao=1-ho=1-gs=8-bs=8-lr=4e_05-ns=4-s=0-r=gpt5m_0
—run_cmd: main_pytorch.py --env_config act_prm/tw_treasure_easy_gpt5m --model_config hf_qwen3_4b_inst_2507 --lora_config r8_a16_qkvo --replay_buffer_config default --log_path ./logs --no_fa2 --generator_config aprm_qwen3_ap --trainer_config aprm_for_sft100 --actions_only --hide_observations --batch_size 8 --group_size 8 --learning_rate 4e-5 --num_substeps 4 --seed 0 --replicate gpt5m_0 --verbose
—batch_idx: 40
—split: train_all
—trajectory_key: think_act_policy
—num_trajectories: 348
—num_episodes: 348
—group_size: 8
—batch_size: 8