datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Latex-VLMXLRS-Bench-lite_VLM
🐙GitHub
Information or evaluatation on this dataset can be found in this repo: https://github.com/AI9Stars/XLRS-Bench
📜Dataset License
Annotations of this dataset is released under a Creative Commons Attribution-NonCommercial 4.0 International License. For images from:
DOTARGB images from Google Earth and CycloMedia (for academic use only; commercial use is prohibited, and Google Earth terms of use apply).
ITCVDLicensed under CC-BY-NC-SA-4.0.
MiniFrance… See the full description on the dataset page: https://huggingface.co/datasets/initiacms/XLRS-Bench-lite_VLM.vlmsareblindArXiv - Website
TransCity-VLM-dataset
TransCity-VLM Dataset
The TransCity-VLM Dataset provides multimodal smart-city data for traffic, energy, mobility, grid operation, urban context understanding, and map-grounded question answering. It supports the training and evaluation of vision-language models for urban prediction, decision support, conversational QA, and reasoning tasks.
The training data are available at this Hugging Face dataset repository.
Dataset Summary
Split
Rows / Files
test JSONL… See the full description on the dataset page: https://huggingface.co/datasets/TransCity-VLM/TransCity-VLM-dataset.Arabic-VLM-Full-Pearl
💎 The Arabic VLM Dataset (Full Pearl Edition)
This repository contains the full, unreviewed dataset comprising 309K multimodal examples. This data was generated automatically using the agentic pipeline developed for the Pearl project, as described in our paper.
Disclaimer: This is the raw, synthetic data that has not been subject to human review. It was generated as part of the data creation process and is released for research purposes. It may contain noise, errors, or… See the full description on the dataset page: https://huggingface.co/datasets/MohamedRashad/Arabic-VLM-Full-Pearl.vlm-projects-multi-lang-final-v2
My Final Multilingual Medical VQA Dataset
This dataset is organized into multiple configurations (subsets), one for each language.
You can load a specific language subset like this:
from datasets import load_dataset
# Load the Vietnamese training data
vi_train = load_dataset("tungvu3196/vlm-projects-multi-lang-final-v2", "Vietnamese", split="train")
# Load the English testing data
en_test = load_dataset("tungvu3196/vlm-projects-multi-lang-final-v2", "English", split="test")
XLRS-Bench-lite_VLM
🐙GitHub
Information or evaluatation on this dataset can be found in this repo: https://github.com/AI9Stars/XLRS-Bench
📜Dataset License
Annotations of this dataset is released under a Creative Commons Attribution-NonCommercial 4.0 International License. For images from:
DOTARGB images from Google Earth and CycloMedia (for academic use only; commercial use is prohibited, and Google Earth terms of use apply).
ITCVDLicensed under CC-BY-NC-SA-4.0.
MiniFrance… See the full description on the dataset page: https://huggingface.co/datasets/zGinger/XLRS-Bench-lite_VLM.VLM-ExecRouterBench
VLM-ExecRouterBench
An execution-oriented benchmark for cost-aware open-set VLM routing.
Cost-aware routing |
Open-set model onboarding |
Multimodal, code, and search tasks
Overview
VLM-ExecRouterBench is an execution-oriented benchmark for routing
vision-language model queries to a pool of candidate VLMs. Each sample is
executed by multiple candidate models, producing correctness labels, inference
costs, metadata… See the full description on the dataset page: https://huggingface.co/datasets/Kirito-Lab/VLM-ExecRouterBench.code-conflict
Code Conflict Dataset
A dataset of 100 visual Python code conflict samples designed to evaluate Vision-Language Models (VLMs) under cross-modal conflicts (discrepancy between code screenshots and caption text).
Dataset Statistics
Total Rows: 100 samples
Language: English (english)
Categories: 5 distinct Python code conflict_types (20 samples per category):
operator_substitution (Rows 1–20): Swapping math or logic operators (e.g., + to -, == to !=, or to and).… See the full description on the dataset page: https://huggingface.co/datasets/multilingual-vlm-conflict/code-conflict.gsm8k-rendered-vlm
Rendered GSM8K-VL Dataset
Rendered GSM8K-VL is a multimodal math-reasoning dataset for vision-language model evaluation.Each example links:
a GSM8K word problem (question)
the final numeric answer (answer)
cleaned chain-of-thought style reasoning (reasoning)
a rendered image path (image)
This dataset is intended for controlled experiments comparing text-only and image-based reasoning behavior.
Canonical Dataset Artifact
The official dataset release uses:… See the full description on the dataset page: https://huggingface.co/datasets/RodelaG/gsm8k-rendered-vlm.rpg-conflict
RPG Fantasy Battle Conflict Dataset
A dataset of 100 visual RPG combat conflict samples designed to evaluate Vision-Language Models (VLMs) under cross-modal conflicts (discrepancy between battle screenshots and caption text). Derived from the rcannizzaro/rpg_fantasy_battle_counterfactual_v2 dataset.
Dataset Statistics
This dataset consists of a single train split containing 100 perfectly isolated conflict samples derived from the… See the full description on the dataset page: https://huggingface.co/datasets/multilingual-vlm-conflict/rpg-conflict.vietnamese-vlm
Vietnamese Industries Insights
About Me
I'm Matteo Khan, a computer science apprentice at TW3 Partners, specializing in Generative AI and NLP. My focus is on creating datasets that improve AI's ability to process complex technical documents.
You can connect with me on LinkedIn: Matteo Khan
Dataset Details
Purpose / Mục Đích
Tiếng Việt:
Bộ dữ liệu này được tạo ra nhằm cung cấp cái nhìn tổng quan về các ngành công nghiệp chủ chốt… See the full description on the dataset page: https://huggingface.co/datasets/MatteoKhan/vietnamese-vlm.3D-Object-ConflictScienceQA_VLMEvalKit
This is a reformated version of ScienceQA dataset for VLMEvalKit.
Below is the original description of ScienceQA dataset:
Dataset Card Creation Guide
Dataset Summary
Learn to Explain: Multimodal Reasoning via Thought Chains for Science Question Answering
Supported Tasks and Leaderboards
Multi-modal Multiple Choice
Languages
English
Dataset Structure
Data Instances
Explore more samples here.
{'image': Image… See the full description on the dataset page: https://huggingface.co/datasets/THU-CVML/ScienceQA_VLMEvalKit.vlm-projects-multi-lang-final
My Final Multilingual Medical VQA Dataset
This dataset is organized into multiple configurations (subsets), one for each language.
You can load a specific language subset like this:
from datasets import load_dataset
vi_train = load_dataset("tungvu3196/vlm-projects-multi-lang-final", "Vietnamese", split="train")
VLM4DVLM-CapCurriculum-TextReasoning-Data
VLM-CapCurriculum-TextReasoning (D_text)
Stage-2 textual-reasoning data for the staged post-training recipe in
"From Seeing to Thinking: Decoupling Perception and Reasoning Improves Post-Training of Vision-Language Models"
(ICML 2026).
A curated ORZ-Math-13k subset — challenging text-only math problems used to consolidate textual reasoning between the perception (Stage 1) and visual-reasoning (Stage 3) RLVR stages of our recipe. Every row also ships with a precomputed pass_rate so… See the full description on the dataset page: https://huggingface.co/datasets/UCSC-VLAA/VLM-CapCurriculum-TextReasoning-Data.modality-conflict-arbitration-v2
Modality-Conflict Arbitration Benchmark (v2)
A controlled benchmark for studying how a vision-language model arbitrates between
its two input channels when they disagree — and whether that choice tracks the
reliability of each channel.
Each row is a single conflict trial: an image of one math problem paired with the
text of a different problem. Because the two ground-truth answers are carried side by
side, the model's output alone tells you which modality it followed — no… See the full description on the dataset page: https://huggingface.co/datasets/vlm-modality-research/modality-conflict-arbitration-v2.vlm_circuitVLM Circuit Datasets Same Task, Different Circuits: Disentangling Modality-Specific Mechanisms in VLMs Yaniv Nikankin ⋅ Dana Arad ⋅ Yossi Gandelsman ⋅ Yonatan Belinkov https://neurips.cc/virtual/2025/loc/san-diego/poster/119472
Hard_images_for_VLMsgomoku_vlm_ds
Gomoku VLM Dataset (LoRA finetuning)
This repository contains a synthetic, image-grounded instruction dataset for training and evaluating vision-language models (VLMs) on Gomoku (15×15).The dataset is designed for LoRA finetuning of image-text-to-text vision-language models on two complementary capabilities:
VisualTasks where the model must read the board image and produce a structured answer about the current position.This includes purely perceptual objectives (cell classification… See the full description on the dataset page: https://huggingface.co/datasets/eganscha/gomoku_vlm_ds.EC-ATOMIC
Dataset Name: EG-ATOMIC
Contributors
Mohamed Gamil
Abdelrahman Elsayed
Abdelrahman Lila
Ahmed Anwar Gad
Hesham Abdelgawad
Mohamed Aref
Overview
Atomic-EgMM is a commonsense event dataset specific to Egyptian culture, covering everyday life, food, celebrations, religious occasions, and cultural practices. Each event captures actions, effects, intentions, needs, and reactions for both the actor (PersonX) and others (O).
It is suitable for tasks like:… See the full description on the dataset page: https://huggingface.co/datasets/CulTex-VLM/EC-ATOMIC.vlm-project-multi-lang-spanish-test
My Multilingual Medical VQA Dataset (Spanish Subset Test)
This repository contains the Spanish subset of the VLM project dataset.