opencsg/autohub-benchmark
autohub-benchmark This project designs common use scenarios for web-based code, model, and dataset hosting platforms, and provides corresponding prompts and ground truth. These resources can be used to evaluate the localization performance of visual language models (VLMs) in specialized scenarios. Model Hosting Platform GUI Inference Model Platform Accuracy (%) Error (%) Invalid (%) Completion Rate (%) AriaUI Huggingface 70.8 12.5 6.7 100.0… See the full description on the dataset page: https://huggingface.co/datasets/opencsg/autohub-benchmark.
1158
1{2 "1_home.png": "Click on the 'Models' tab to navigate to the models page. ",3 "2_0_models.png": "Search for the 'deepseek-v3' model on the current page. ",4 "2_1_deepseek-v3.png": "Click the 'Like' button on this page for the 'deepseek-v3' model. ",5 "2_2_deepseek-v3_modefile.png": "Click the download icon to download the largest model file in the 'deepseek-v3' files section. ",6 "2_3_deepseek-v3_discussions.png": "Click on the most recent discussion or pull request on the 'deepseek-v3' discussions page. ",7 "2_4_deepseek-v3_issue.png": "Summarize the discussion content on this issue page and leave a comment saying, 'Thank you, this is very helpful.' ",8 "2_5_deepseek-v3_collection.png": "Check how many categories the current model 'deepseek-v3' has in its collections section. ",9 "3_0_datasets.png": "Use the search or filter function to locate the 'opencsg' dataset on the current page. ",10 "3_1_opencsg-chinese-fineweb-edu-v2.png": "Summarize the information provided on this page about the 'opencsg-chinese-fineweb-edu-v2' dataset and download the dataset. ",11 "3_2_opencsg-smoltalk-chinese.png": "Summarize the information provided on this page about the 'opencsg-smoltalk-chinese' dataset and download the dataset. "12}