Modelpublic

3CTeam/fpvla-stage2-827-50k

sourceHugging Faceapache-2.0updated 7d agoView on Hugging Face

0likes59downloads

Model Card

3cteam/fpvla-stage2-827

FP-VLA (Vision-Language-Action) model with trace prediction capability, fine-tuned from openvla/openvla-7b.

Model Architecture

Component	Type
Trace Head	`linear`
Action Head	`mlp`

Linear Trace Head

—Direct regression via nn.Linear for trajectory prediction
—Deterministic inference (no sampling noise)
—Input: 66 learnable query tokens (conditioned on image + past trajectory)
—Output: 33-point normalized trajectory [33, 2]

Usage

python

from prismatic.extern.hf.configuration_prismatic import OpenVLAConfig
from prismatic.extern.hf.modeling_prismatic import OpenVLAForActionPrediction

# Load config + model (constructor + manual weight loading)
config = OpenVLAConfig.from_pretrained("YOUR_REPO_ID")
model = OpenVLAForActionPrediction(config)

import glob
from safetensors.torch import load_file
state_dict = {}
for shard in sorted(glob.glob("YOUR_REPO_ID/*.safetensors")):
    state_dict.update(load_file(shard))
model.load_state_dict(state_dict, strict=False)

Evaluation

bash

python vla_scripts/eval_trace_mix.py \
    --model_path YOUR_REPO_ID \
    --base_vla_path openvla/openvla-7b \
    --data_root_dir data \
    --dataset_name trace_mix \
    --output_dir runs/eval \
    --max_samples 64

License

Apache-2.0