Apppublic

shreyask/falcon-perception

sourceHugging Faceapache-2.0updated 5mo agoView on Hugging Face

2likes

App README

🦅 Falcon-Perception-0.6B WebGPU

A browser demo for [tiiuae/Falcon-Perception](https://huggingface.co/tiiuae/Falcon-Perception) — a 0.6B open-vocabulary VLM that turns natural-language queries into bounding boxes and pixel-accurate segmentation masks, running fully client-side via WebGPU + ONNX Runtime Web.

![Model](https://huggingface.co/tiiuae/Falcon-Perception) ![Weights](https://huggingface.co/onnx-community/falcon-perception-onnx-webgpu)

What's inside

—Detection — draw bounding boxes for any natural-language query ("athletes", "the runner in front", "mangoes").
—Segmentation — pixel-accurate masks via the AnyUp upsampler, all in-browser.
—Tracker (preview) — HUD-style reticles on video. Limited by VLM latency between detections; see the in-space disclaimer.

How it runs

2.4 GB of ONNX weights are fetched once on first visit, then cached by your browser — no backend, no API keys, no network round-trip after load. Multi-threaded WASM is enabled via coi-serviceworker.