GameWorldData/HUD-UI-Validation-Pilot
HUD/UI annotation validation pilot This public artifact compares 10 gameplay screenshots across four columns: raw frame; GPT-5.6 Sol X-High final reference; GPT-5.6 Terra High refined annotation; confidence-routed final annotation. Files: analysis.md: aggregate metrics and per-game error table; per_sample_metrics.csv: machine-readable sample metrics; overlay_comparison_contact_sheet.jpg: full comparison sheet. The 0--100 confidence value is a conservative pipeline routing… See the full description on the dataset page: https://huggingface.co/datasets/GameWorldData/HUD-UI-Validation-Pilot.
0167
1# Confidence-aware HUD pilot analysis2 3- Samples: 104- Pure Terra refined element F1: 0.77555- Pure Terra mean slot Jaccard: 0.68756- Routed-final element F1: 0.80007- Candidate escalated samples: 38- Candidate human-review samples: 09- Pearson(pre-routing pipeline confidence, slot Jaccard): -0.313910 11The confidence score is a routing signal, not a calibrated correctness probability.12 13| Game | Jaccard | Pre-routing pipeline conf. | Escalated | Missed | Extra | Scene | Visible |14|---|---:|---:|:---:|---|---|:---:|:---:|15| Nathan Morgan: Dilemma | 0.000 | 97 | no | crosshair | - | OK | wrong |16| Yakuza Kiwami | 0.333 | 94 | no | match_status,world_marker | other_hud,progress_meter | OK | OK |17| Marvel's Spider-Man: Miles Morales | 0.500 | 84 | no | tutorial_control_hint | - | OK | OK |18| Ratchet & Clank | 0.625 | 69 | yes | stamina_energy | identity_level_xp,vehicle_speed_gear | OK | OK |19| Alan Wake | 0.667 | 91 | no | quickslot_inventory | - | wrong | OK |20| Yakuza: Like a Dragon | 0.750 | 69 | yes | progress_meter | - | OK | OK |21| Aragami 2 | 1.000 | 80 | no | - | - | OK | OK |22| Clone Drone in the Danger Zone | 1.000 | 69 | yes | - | - | wrong | OK |23| Dead Space 2 | 1.000 | 95 | no | - | - | OK | OK |24| Hellblade: Senua's Sacrifice | 1.000 | 96 | no | - | - | OK | OK |25