MemGym/memgym-rm-scenario-ood-webarena
MemGym-RM Scenario-OOD — WebArena V2 Description MemGym-RM-Scenario-OOD-WebArena is a held-out evaluation set designed to test whether MemRM generalizes to a completely different agent domain (WebArena browser tasks) not seen during training (which used SWE-Gym software engineering tasks). Each row is a trajectory step from a WebArena agent running under one of three memory cohorts, with a scenario_swap perturbation applied. OOD axis: Agent scenario / task domain… See the full description on the dataset page: https://huggingface.co/datasets/MemGym/memgym-rm-scenario-ood-webarena.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face