RinnRinnmini/qwen3-4b-agent-trajectory-merged-sftdpo_v5
013
qwen3-4b-agent-trajectory-merged-sftdpo_v5
This repository provides a merged model based on Qwen/Qwen3-4B-Instruct-2507. The LoRA adapter (after DPO) has been merged into the base model.
Load directly with transformers (no PEFT adapter loading required).
