datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
memgym-rm-scenario-ood-webarena
MemGym-RM Scenario-OOD — WebArena V2
Description
MemGym-RM-Scenario-OOD-WebArena is a held-out evaluation set designed to test whether MemRM generalizes to a completely different agent domain (WebArena browser tasks) not seen during training (which used SWE-Gym software engineering tasks). Each row is a trajectory step from a WebArena agent running under one of three memory cohorts, with a scenario_swap perturbation applied.
OOD axis: Agent scenario / task domain (SWE-Gym… See the full description on the dataset page: https://huggingface.co/datasets/MemGym/memgym-rm-scenario-ood-webarena.agent_trajectory_reviews