CoolFace
Modelpublic

paperuploadacount/EO-Gym-4B

sourceHugging Faceotherupdated 5mo agoView on Hugging Face
0likes15downloads
Model Card

EO-Gym-4B

EO-Gym-4B is a LoRA adapter for Qwen/Qwen3-VL-4B-Instruct, fine-tuned for Earth-observation visual question answering and tool-use style reasoning with the EO-Gym dataset.

This repository contains adapter weights only. Load it with the base model Qwen/Qwen3-VL-4B-Instruct; it is not a standalone full checkpoint.

Model Details

  • —Model type: PEFT LoRA adapter for a multimodal causal language model.
  • —Base model: Qwen/Qwen3-VL-4B-Instruct.
  • —Adapter method: LoRA.
  • —LoRA rank: 16.
  • —LoRA alpha: 32.
  • —LoRA dropout: 0.05.
  • —Target modules: Qwen3-VL language-model projection layers matching q_proj, k_proj, v_proj, o_proj, gate_proj, up_proj, and down_proj.
  • —Training dtype: bfloat16.
  • —PEFT version: 0.18.0.
  • —Primary dataset: paperuploadacount/EO-Gym.

Intended Use

The adapter is intended for research on Earth-observation multimodal question answering, remote-sensing image interpretation, and EO-Gym tool-augmented reasoning workflows.

It is not intended for safety-critical geospatial decisions, emergency response, legal determinations, or fully automated operational monitoring without human review and task-specific validation.

Quick Start

Install current Hugging Face and PEFT packages compatible with Qwen3-VL:

bash
pip install "transformers>=4.57" "peft>=0.18" qwen-vl-utils decord accelerate

Load the adapter with the base model:

python
import torch
from peft import PeftModel
from transformers import AutoModelForImageTextToText, AutoProcessor

base_model_id = "Qwen/Qwen3-VL-4B-Instruct"
adapter_id = "paperuploadacount/EO-Gym-4B"

processor = AutoProcessor.from_pretrained(base_model_id)
model = AutoModelForImageTextToText.from_pretrained(
    base_model_id,
    torch_dtype=torch.bfloat16,
    device_map="auto",
)
model = PeftModel.from_pretrained(model, adapter_id)
model.eval()

For EO-Gym evaluation, use this adapter with the EO-Gym tool server and the dataset examples in paperuploadacount/EO-Gym.

Training Data

The adapter was fine-tuned on EO-Gym examples, a dataset of Earth-observation visual question-answering and tool-use interactions. The dataset repository is paperuploadacount/EO-Gym.

The uploaded dataset card configures the primary JSONL splits:

  • —datasets/eo_gym_train_set.jsonl: training split.
  • —datasets/eo_gym_test_set.jsonl: test split.

Training Procedure

Key training settings recorded from the local training run:

  • —Training type: LoRA supervised fine-tuning.
  • —Epochs: 3.
  • —Per-device train batch size: 4.
  • —Gradient accumulation steps: 16.
  • —Learning rate: 1e-4.
  • —LR scheduler: cosine.
  • —Weight decay: 0.1.
  • —Max sequence length: 8192.
  • —Max image pixels: 1,003,520.
  • —Optimizer: adamw_torch_fused.
  • —Vision tower: frozen.
  • —Aligner: frozen.
  • —Seed: 42.

The model card intentionally omits local filesystem paths and private training checkpoint locations.

Evaluation

The final validation record from the training run reports:

  • —Step: 273.
  • —Epoch: 3.0.
  • —Validation loss: 0.16282493.
  • —Validation token accuracy: 0.96108994.

These numbers are training-run validation metrics, not a full external benchmark. For reproducible downstream reporting, evaluate against the committed EO-Gym test split with the EO-Gym tool server and your selected inference backend.

Limitations

  • —The adapter inherits the capabilities and limitations of Qwen/Qwen3-VL-4B-Instruct.
  • —Performance depends on prompt format, image preprocessing, and availability of the EO-Gym tool server for tool-augmented workflows.
  • —Remote-sensing tasks can be sensitive to resolution, projection, bands, cloud cover, and temporal coverage; validate outputs against authoritative sources.
  • —The adapter should be treated as a research artifact until independently evaluated for a specific deployment setting.

Files

  • —adapter_model.safetensors: LoRA adapter weights.
  • —adapter_config.json: PEFT adapter configuration.
  • —additional_config.json: training framework adapter metadata.
  • —.gitattributes: LFS hints for binary model artifacts.
  • —.hfignore: excludes optimizer and trainer state from Hub uploads.

Citation

No paper citation is provided for this checkpoint. If you use the adapter, please cite the EO-Gym dataset and the Qwen3-VL base model according to their respective citation guidance.