p-doom/AGI-CAST-idm-actions

AGI-CAST IDM Actions We release model-generated keyboard, mouse-click, cursor-movement and scroll annotations for the AGI-CAST-0.6k screencast dataset. The labels were generated with p-doom/idm, an inverse dynamics model trained to recover user input actions from short windows of screen recordings. Please refer to the AGI-CAST blog post and the IDM blog post for more context. Code These labels were generated with p-doom/idm. The… See the full description on the dataset page: https://huggingface.co/datasets/p-doom/AGI-CAST-idm-actions.