shiqihe/WebVoyager-GAIA-SparseAttention-Offline-Qwen3-VL-30B-A3B

Sparse Attention for Web Agents — Offline Replay Records Step-level records from an offline replay study comparing three sparse-attention methods against full attention on browser-agent trajectories. Model: Qwen3-VL-30B-A3B-Instruct (48 layers, 128 experts / 8 active, GQA 32:4, head_dim 128) Hardware: NVIDIA GB10 (sm_121) Tasks: 50 complete trajectories sampled from WebVoyager + GAIA — 332 steps, of which 190 emit an element index. Every task was completed successfully by the… See the full description on the dataset page: https://huggingface.co/datasets/shiqihe/WebVoyager-GAIA-SparseAttention-Offline-Qwen3-VL-30B-A3B.