Modelpublic

metacognitive-behavioral-tuning/Qwen3-1.7B-gpt-oss-distill

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face

0likes12downloads

Model Card

Qwen3-1.7B · gpt-oss-distill

gpt-oss-distill (appendix) — final checkpoint (SFT → GRPO). Base: `Qwen/Qwen3-1.7B`. Paper: Metacognitive Behavioral Tuning of Large Language Models for Multi-Hop Question Answering.

—Method: gpt-oss-distill: naive distillation of teacher (gpt-oss-120b) raw traces via SFT, then GRPO.
—Base model: Qwen/Qwen3-1.7B
—Training: SFT (LR 1e-4, BS 128, HotpotQA) → GRPO
—Benchmarks: HotpotQA (ID), MuSiQue / 2WikiMultiHopQA (OOD)

Usage

python

from transformers import AutoModelForCausalLM, AutoTokenizer

repo = "metacognitive-behavioral-tuning/Qwen3-1.7B-gpt-oss-distill"
tok = AutoTokenizer.from_pretrained(repo)
model = AutoModelForCausalLM.from_pretrained(repo, dtype="bfloat16", device_map="auto")