CoolFace
Datasetpublic

CL-From-Nothing/RLVE-Test-Qwen3-1.7B-SFT-warmup-Pass8

RLVE test eval — SFT warmup (pass@8) Evaluation rollouts on the RLVE test split. Model: Qwen3-1.7B-SFT-rlve-20K-1epoch (RL-warmup baseline, pre-RL) Source prompts: RLVE test split — 180 questions (RLVE-Eval Gym environments) Sampling: 8 samples/question (pass@8) = 1440 records, temperature 0.7, max 16384 new tokens Rewards: inline RLVE-Eval Gym verifier score (continuous, in [-1, 1]). Record-level accuracy (reward>0): 176 / 1440 = 12.2%, mean reward -0.724 pass@8 (>=1 of 8… See the full description on the dataset page: https://huggingface.co/datasets/CL-From-Nothing/RLVE-Test-Qwen3-1.7B-SFT-warmup-Pass8.

sourceHugging Faceapache-2.0updated 4mo agoView on Hugging Face
0likes6downloads
Dataset Card

RLVE test eval — SFT warmup (pass@8)

Evaluation rollouts on the RLVE test split.

  • —Model: Qwen3-1.7B-SFT-rlve-20K-1epoch (RL-warmup baseline, pre-RL)
  • —Source prompts: RLVE test split — 180 questions (RLVE-Eval Gym environments)
  • —Sampling: 8 samples/question (pass@8) = 1440 records, temperature 0.7, max 16384 new tokens
  • —Rewards: inline RLVE-Eval Gym verifier score (continuous, in [-1, 1]).
  • —Record-level accuracy (reward>0): 176 / 1440 = 12.2%, mean reward -0.724
  • —pass@8 (>=1 of 8 samples reward>0): 63 / 180 = 35.0%

Record schema (one JSON object per line)

fieldmeaning
indexquestion index (0-179)
sample_idsample id within the question (0-7)
data_source"rlve"
promptthe problem statement
responsethe model's generated solution (full chain-of-thought)
rewardsGym-verifier reward in [-1, 1]
metadataJSON string: environment name + config (for the verifier)
answerground-truth answer