Modelpublic

pierretokns/smolvlm-500m-ccmcp-v1

sourceHugging Faceapache-2.0updated 8mo agoView on Hugging Face

0likes75downloads

Model Card

smolvlm-500m-ccmcp-v1

GUI grounding model trained on ScreenSpot dataset for Claude-compatible computer use.

Files

File	Description	Size
`mmproj-smolvlm-500m-ccmcp-v1-f16.gguf`	Vision projector (F16)	190.2 MB
`smolvlm-500m-ccmcp-v1-Q4_K_M.gguf`	Main model (Q4KM)	289.2 MB
`smolvlm-500m-ccmcp-v1-f16.gguf`	Main model (F16)	782.4 MB

Training

—Base Model: HuggingFaceTB/SmolVLM-500M-Instruct
—Dataset: ScreenSpot GUI grounding (1,017 examples)
—Method: LoRA fine-tuning (r=16, alpha=32)
—Task: Predict click coordinates in Claude format

Output Format

json

{"action": "left_click", "coordinate": [847, 523]}

Usage with Ollama

dockerfile

# Modelfile
FROM ./smolvlm-500m-ccmcp-v1-Q4_K_M.gguf
FROM ./mmproj-smolvlm-500m-ccmcp-v1-f16.gguf
PARAMETER num_ctx 4096
PARAMETER temperature 0.1
SYSTEM "You are a GUI grounding assistant. Given a screenshot and instruction, output click coordinates as JSON."

bash

ollama create smolvlm_500m_ccmcp_v1 -f Modelfile
ollama run smolvlm_500m_ccmcp_v1 --image screenshot.png "Click the Submit button"

License

Apache 2.0 (inherits from base model)