vitrus/gen-humanego-semantic-field
VITRUS Gen-HumanEgo Semantic Field
Visual search and synchronized-view inspection for the verified 114-episode Gen-HumanEgo industrial canary.
Run locally
python3 server.py --port 4202Open http://127.0.0.1:4202/.
Current index
- 114 MCAP episodes
- 684 decoded previews: six synchronized RGB cameras per episode
- zero extraction failures
- annotation-aware search across factory, station, activity, episode description, task, and active subtask
- source episode path, timestamp, duration, success label, and modality inventory retained in
data/index.json
The compact index is a derivative preview. The original MCAP episodes in the Gen-HumanEgo dataset remain the source of truth.
Source dataset: genrobot2025/Gen-HumanEgo, licensed under CC-BY-SA-4.0. This public Space contains a compact set of decoded preview frames derived from the 114-episode industrial sample and links each view back to its source episode metadata.
Rebuild
Run extract_canary.py inside an environment containing mcap, mcap-protobuf-support, and Pillow. FFmpeg is required to decode H.264 camera windows.
The current ranker searches the supplied hierarchy and temporal annotations. It does not yet claim learned image-to-text retrieval. The intended next stage is to replace the ranker with precomputed LVL-1.1 image/episode embeddings while preserving the same review interface and source receipts.
