datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Multimodal-Mind2Web
Dataset Summary
Multimodal-Mind2Web is the multimodal version of Mind2Web, a dataset for developing and evaluating generalist agents
for the web that can follow language instructions to complete complex tasks on any website. In this dataset, we align each HTML document in the dataset with
its corresponding webpage screenshot image from the Mind2Web raw dump. This multimodal version addresses the inconvenience of loading images from the ~300GB Mind2Web Raw Dump.
Dataset… See the full description on the dataset page: https://huggingface.co/datasets/osunlp/Multimodal-Mind2Web.minibench-multimodal-mind2webmind2web-mcq-datasetMM-Mind2Web-testminibench-mind2webMultimodal-Mind2Web-filtered处理自https://huggingface.co/datasets/osunlp/Multimodal-Mind2Web
删除了训练集
删除了html信息
保留了pos_candidates的bbox信息(x, y, w, h),删除了其它pos_candidates和neg_candidates的信息
添加了图片width, height信息
删除了不包含pos_candidates或不包含screenshot的样本
Multimodal-Mind2Web
cua-lite/Multimodal-Mind2Web
cua-lite preprocessed version of Multimodal-Mind2Web (osunlp/Multimodal-Mind2Web). The screenshot-augmented Mind2Web web-agent benchmark: real human-annotated multi-step navigation episodes across 100+ websites. Only the train split is processed (the test_task/test_website/test_domain benchmark holdouts are never trained on). Episodes containing a native minibench-mm-mind2webMultimodal-Mind2Web-HTML-WM-messagesMultimodal-Mind2Web-HTML-WM-messages-testmirror-Multimodal-Mind2Web
Dataset Summary
Multimodal-Mind2Web is the multimodal version of Mind2Web, a dataset for developing and evaluating generalist agents
for the web that can follow language instructions to complete complex tasks on any website. In this dataset, we align each HTML document in the dataset with
its corresponding webpage screenshot image from the Mind2Web raw dump. This multimodal version addresses the inconvenience of loading images from the ~300GB Mind2Web Raw Dump.… See the full description on the dataset page: https://huggingface.co/datasets/alucent/mirror-Multimodal-Mind2Web.Multimodal-Mind2Web-HTML-WM-messages-filter-35000Multimodal-Mind2Web-HTML-WM
