Modelpublic

RinnRinnmini/qwen3-4b-agent-trajectory-merged3-sftdpo_v8

sourceHugging Faceapache-2.0updated 7mo agoView on Hugging Face

0likes16downloads

Model Card

qwen3-4b-agent-trajectory-merged-sftdpo_v8

This repository provides a merged model based on Qwen/Qwen3-4B-Instruct-2507. The LoRA adapter (after DPO) has been merged into the base model.

Load directly with transformers (no PEFT adapter loading required).