CoolFace
Modelpublic

laion/a3-rl-DCAgent_exp_rpt_e2egit-v2-10-8B

sourceHugging Faceapache-2.0updated 23d agoView on Hugging Face
0likes1kdownloads
Model Card

a3-rl-DCAgentexprpt_e2egit-v2 (step 10, 8B)

RL checkpoint from SkyRL (RLOOn, FSDP2) trained on the `exprpte2egit-v2` terminal-bench task set. This is the EMA-best checkpoint (`globalstep_10`) selected from a legitimately-completed run (2 epochs x 7 steps/epoch = 14 training steps; lead SLURM job 515469, exit 0).

  • —Base model: laion/GLM-4_7-swesmith-sandboxes-with_tests-oracle_verified_120s-maxeps-131k-fixthink (Qwen3-8B architecture)
  • —Dataset: DCAgent/exp_rpt_e2egit-v2
  • —Algorithm: RLOOn, no KL loss, epsclip 0.2/0.05, lr 8e-6, trainbatchsize 64
  • —Selection: EMA (alpha=1/3, 5-period) of reward/avg_raw_reward, step 10 EMA=0.6787

Training Traces

Training-time Daytona/Harbor rollouts for this run are uploaded as a companion dataset: