CoolFace
Modelpublic

Myungkyu/qwen3_vl_8b_robodojo_taco_lora_b16_10k

sourceHugging Faceupdated 16d agoView on Hugging Face
0likes16downloads
Model Card

qwen3vl8brobodojotacolorab16_10k

High-level planner for RoboDojo long-horizon (8 real-robot bimanual tabletop tasks, 100 demonstrations each): Qwen/Qwen3-VL-8B-Instruct fine-tuned with LoRA on the per-tick planning records of `Myungkyu/RoboDojo-taco-gemini` — demonstrations with dense subtask labels from the task-specific context (offline annotation).

  • —LoRA adapter (PEFT) for Qwen/Qwen3-VL-8B-Instruct: r=32, alpha=64, dropout=0.0 on the language-model q/k/v/o/gate/up/down projections; step 10000 of a 10000-step run (optimizer state not included)
  • —Contract: recent head-camera frames + task goal + carried memory text → JSON with the current subtask, the updated memory, a keyframe flag with caption and a retrieval query
  • —Optimizer batch 16, 10000 steps, learning rate 2e-4; this repo holds the adapter of step 10000 only (load with peft.PeftModel.from_pretrained(base, repo) on top of Qwen/Qwen3-VL-8B-Instruct, or merge for inference)