CoolFace
Modelpublic

xw1234gan/seccodeplt-qwen2.5-coder-7b-grpo-kl-beta-0.001-real-reward-v2

sourceHugging Faceupdated 1mo agoView on Hugging Face
0likes55downloads
Model Card

seccodeplt-qwen2.5-coder-7b-grpo-kl-beta-0.001-real-reward-v2

GRPO with KL regularization (beta=0.001) for the SecCodePLT+ compliance experiment using Qwen/Qwen2.5-Coder-7B-Instruct. This v2 run corrects causal-label alignment and uses the official ReaL safety-unit-test reward with DAPO-style token loss and dynamic sampling. Training used seed 42 and the official 655-example training split. Evaluation used greedy decoding on all 164 official test examples.

Evaluation

MetricValue
Mean reward0.511317
Output format pass98.78%
Syntax pass98.17%
Capability pass38.41%
Safety pass64.02%
Joint pass31.10%

Limitations

This is a single-seed research checkpoint evaluated with the benchmark's resource-bounded Python verifier. It is not a general guarantee of secure code.