datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
IDMR-train
📑 IDMR Dataset (Training Set)
This repository provides the IDMR training dataset, accompanying the paper:
IDMR: Towards Instance-Driven Precise Visual Correspondence in Multimodal Retrieval
📄 arXiv 2504.00954 | 💻 GitHub
📘 Overview
The IDMR dataset is designed for Instance-Driven Multimodal Retrieval, supporting large-scale training across diverse multimodal sources.
This dataset enables research on:
Cross-dataset multimodal retrieval
Instance-driven alignment… See the full description on the dataset page: https://huggingface.co/datasets/lbw18601752667/IDMR-train.idm_ft_newThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 501,
"total_frames": 154063,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:501"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/FrozenAngel/idm_ft_new.idm_testThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "so_follower",
"total_episodes": 10,
"total_frames": 3167,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 30,
"splits": {
"train": "0:10"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/FrozenAngel/idm_test.id-maxD1000
max_context_length: 128
max_documents_per_subject: 1000
IDM-Multiple
IDM-Multiple
IDM-Multiple is part of the IDMBench in AgentStudio for evaluating agent's ability to learn from Internet-scale videos without action labels. Specifically, this dataset requires VLMs to answer an action sequence within a video clip of screen recoding. Please note that this dataset is a test set rather than a training set. Therefore, please do not use it for training. More details are provided in the project page.
id-maxD500
max_context_length: 128
max_documents_per_subject: 500
AGI-CAST-idm-actions
AGI-CAST IDM Actions
We release model-generated keyboard, mouse-click, cursor-movement and scroll annotations for the AGI-CAST-0.6k screencast dataset.
The labels were generated with p-doom/idm, an inverse dynamics model trained to recover user input actions from short windows of screen recordings.
Please refer to the AGI-CAST blog post and the IDM blog post for more context.
Code
These labels were generated with p-doom/idm.
The… See the full description on the dataset page: https://huggingface.co/datasets/p-doom/AGI-CAST-idm-actions.IDM-Single
IDM-Single
IDM-Single is part of the IDMBench in AgentStudio for evaluating agent's ability to learn from Internet-scale videos without action labels. Specifically, this dataset requires VLMs to answer the action transition between two screenshots. Please note that this dataset is a test set rather than a training set. Therefore, please do not use it for training. More details are provided in the project page.
id-maxD100
max_context_length: 128
max_documents_per_subject: 100
ID-MoCQA
ID-MoCQA: Indonesian Multi-hop Question Answering for Complex Cultural Understanding
Dataset Description
Paper: No Shortcuts to Culture: Indonesian Multi-hop Question Answering for Complex Cultural Understanding
Dataset Summary
ID-MoCQA is the first large-scale multi-hop question answering dataset for assessing the cultural understanding of large language models (LLMs), grounded in Indonesian traditions and available in both English and Indonesian.
Unlike… See the full description on the dataset page: https://huggingface.co/datasets/vynsk/ID-MoCQA.IDMGSP-danish
IDMGSP Danish Translated
Danish translated version of the original IDMGSP dataset. This Danish version contains all abstracts from the classifier_input subset. Translated using an Nllb-200-Distilled-600M. Made as part of the DM-AI 2023 competition
africa-idmc-event-data-for-som
Somalia - Internal Displacements Updates (IDU) (event data) | Africa (original)
Size category: 1K<n<10K - Formats: parquet - Sector: governance_security - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-idmc-event-data-for-som.africa-idmc-idp-data-com
Comoros - Internal Displacements (New Displacements) – IDPs | Africa (original)
Size category: n<1K - Formats: parquet - Sector: governance_security - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets help… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-idmc-idp-data-com.africa-idmc-idp-data-dza
Algeria - Internal Displacements (New Displacements) – IDPs | Africa (original)
Size category: n<1K - Formats: parquet - Sector: governance_security - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets help… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-idmc-idp-data-dza.africa-idmc-event-data-for-ssd
South Sudan - Internal Displacements Updates (IDU) (event data) | Africa (original)
Size category: n<1K - Formats: parquet - Sector: governance_security - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-idmc-event-data-for-ssd.africa-idmc-event-data-for-cod
Democratic Republic of the Congo - Internal Displacements Updates (IDU) (event data) | Africa (original)
Size category: n<1K - Formats: parquet - Sector: governance_security - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-idmc-event-data-for-cod.africa-idmc-event-data-for-ago
Angola - Internal Displacements Updates (IDU) (event data) | Africa (original)
Size category: n<1K - Formats: parquet - Sector: humanitarian_development - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-idmc-event-data-for-ago.africa-idmc-idp-data-caf
Central African Republic - Internal Displacements (New Displacements) – IDPs | Africa (original)
Size category: n<1K - Formats: parquet - Sector: governance_security - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-idmc-idp-data-caf.africa-idmc-idp-data-gha
Ghana - Internal Displacements (New Displacements) – IDPs | Africa (original)
Size category: n<1K - Formats: parquet - Sector: governance_security - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets help… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-idmc-idp-data-gha.africa-idmc-idp-data-lbr
Liberia - Internal Displacements (New Displacements) – IDPs | Africa (original)
Size category: n<1K - Formats: parquet - Sector: governance_security - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets help… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-idmc-idp-data-lbr.africa-idmc-idp-data-ago
Angola - Internal Displacements (New Displacements) – IDPs | Africa (original)
Size category: n<1K - Formats: parquet - Sector: governance_security - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets help… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-idmc-idp-data-ago.idmgsp_abstractsafrica-idmc-idp-data-eth
Ethiopia - Internal Displacements (New Displacements) – IDPs | Africa (original)
Size category: n<1K - Formats: parquet - Sector: governance_security - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets help… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-idmc-idp-data-eth.africa-idmc-idp-data-sdn
Sudan - Internal Displacements (New Displacements) – IDPs | Africa (original)
Size category: n<1K - Formats: parquet - Sector: governance_security - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets help… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-idmc-idp-data-sdn.africa-idmc-event-data-for-sdn
Sudan - Internal Displacements Updates (IDU) (event data) | Africa (original)
Size category: n<1K - Formats: parquet - Sector: governance_security - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets help… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-idmc-event-data-for-sdn.africa-idmc-event-data-for-nga
Nigeria - Internal Displacements Updates (IDU) (event data) | Africa (original)
Size category: n<1K - Formats: parquet - Sector: governance_security - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets help… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-idmc-event-data-for-nga.africa-idmc-event-data-for-bdi
Burundi - Internal Displacements Updates (IDU) (event data) | Africa (original)
Size category: n<1K - Formats: parquet - Sector: humanitarian_development - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-idmc-event-data-for-bdi.africa-idmc-idp-data-nga
Nigeria - Internal Displacements (New Displacements) – IDPs | Africa (original)
Size category: n<1K - Formats: parquet - Sector: governance_security - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets help… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-idmc-idp-data-nga.IDM-batch2
IDM-batch2
Second batch of IDM math trap items, in the same schema as GYASBGFUHAADSGADF/IDM-batch1.
Dataset summary
Rows: 152
File: upload_batch2.jsonl
Trap types: Contradiction (130), Missing conditions (22)
Splits (field split): train (139), test (13)
Fields
Field
Description
original
Original math problem
trap
Trap / modified problem
annotation
Explanation of the trap
trap type
Trap category
source
Problem source
level… See the full description on the dataset page: https://huggingface.co/datasets/GYASBGFUHAADSGADF/IDM-batch2.africa-idmc-idp-data-lby
Libya - Internal Displacements (New Displacements) – IDPs | Africa (original)
Size category: n<1K - Formats: parquet - Sector: governance_security - Engineered by Electric Sheep Africa
TL;DR
This dataset is part of the Electric Sheep Africa catalog on Hugging Face. It is indexed for African data discovery with standardized metadata, loading guidance, provenance notes, and analyst-oriented context.
What This Dataset Covers
Public datasets help… See the full description on the dataset page: https://huggingface.co/datasets/electricsheepafrica/africa-idmc-idp-data-lby.