Modelpublic

SeongryongJung/qwen3-8b-tooluse-sdpo-ema005

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face

0likes8downloads

Model Card

qwen3-8b-tooluse-sdpo-ema005

This repository contains the last checkpoint (global_step_100) for qwen3gen-tooluse-SDPO-Qwen-Qwen3-8B-mbs32-ema0.05-train64-rollout8-lr1e-5-vllm0.8, converted to Hugging Face Transformers format.

Evaluation

The reported headline score is the best validation `mean@16` observed during training. It is not necessarily the score of the uploaded last checkpoint.

Dataset	Method	Model	Uploaded checkpoint	Best val mean@16	Best step	Final val mean@16
tooluse	SDPO	Qwen3-8B	globalstep100	69.21%	20	60.94%

[image]

Raw result files:

—results/validation_mean16.csv
—results/training_scores.csv
—artifacts/config.yaml
—artifacts/wandb-summary.json

Training Setup

—Base model: Qwen/Qwen3-8B
—Dataset: tooluse
—Method: SDPO
—EMA teacher update rate: 0.05
—Uploaded weights: last checkpoint, global_step_100
—Validation metric used for headline score: val-aux/*/mean@16
—Validation sampling: n=16

Usage

python

from transformers import AutoModelForCausalLM, AutoTokenizer

repo_id = "SeongryongJung/qwen3-8b-tooluse-sdpo-ema005"
tokenizer = AutoTokenizer.from_pretrained(repo_id, trust_remote_code=True)
model = AutoModelForCausalLM.from_pretrained(
    repo_id,
    torch_dtype="auto",
    device_map="auto",
    trust_remote_code=True,
)

Notes

Most best-validation intermediate checkpoints were not retained as full actor checkpoints because training kept only the latest actor checkpoint. Therefore, this repository publishes the last checkpoint and records the best validation score separately.