mikuhhn1239/qwen3-8b-narrative-parsing-lora

输入:
  [1] "你怎么来了？"
  [2] 她愣了一下。
  [3] 其实我也不知道自己为什么会来。

输出:
  {"labels": [
    {"unit_id": "1", "type": "dialogue"},
    {"unit_id": "2", "type": "action"},
    {"unit_id": "3", "type": "thought"}
  ]}

from transformers import AutoModelForCausalLM
from peft import PeftModel

base = AutoModelForCausalLM.from_pretrained(
    "mikuhhn1239/qwen3-8b-novel-base-sft",
    torch_dtype="auto", device_map="auto",
)
model = PeftModel.from_pretrained(
    base, "mikuhhn1239/qwen3-8b-narrative-parsing-lora"
)

基座: Qwen3-8B-Novel-Base-SFT (Stage1 全参 SFT, 72K 小说续写数据)
方法: LoRA (r=64, α=128, dropout=0.05)
数据: 616 条 (577 train / 39 val / 39 test)
框架: transformers Trainer + PEFT
优化器: AdamW (adamw_torch_fused), cosine schedule, warmup=5%
epoch: 5 | LR: 1e-4 | batch: 1×16(accum) | bf16 | max_length: 4096