datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
GameplayQA
GameplayQA: A Decision-Dense POV-Synced Multi-Video
Understanding Benchmark of 3D Virtual Agents
Yunzhe Wang
Runhui Xu
Kexin Zheng
Tianyi Zhang
Jayavibhav N. Kogundi
Soham Hans
Volkan Ustun
University of Southern California
ACL 2026
Corresponding Author: yunzhewa@usc.edu
Overview
GameplayQA is the first benchmark for POV-Synced Multi-Video Understanding and… See the full description on the dataset page: https://huggingface.co/datasets/wangyz1999/GameplayQA.cyberpunk-gameplay-data
赛博朋克
This public dataset repository contains local gameplay data uploaded from F:\赛博朋克.
Contents
Files: 473
Total local size: 363.44 GB
Generated: 2026-06-09 08:27:59 UTC
File Types
.jsonl: 144
.json: 110
.png: 108
.mkv: 36
.txt: 36
.parquet: 36
.exe: 2
.mp4: 1
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The license is marked as other; review game… See the full description on the dataset page: https://huggingface.co/datasets/xiaoluo11/cyberpunk-gameplay-data.volcano-princess-gameplay-data
火山的女儿
This public dataset repository contains local gameplay data uploaded from F:\火山的女儿.
Contents
Files: 434
Total local size: 242.73 GB
Generated: 2026-06-08 06:39:58 UTC
File Types
.jsonl: 129
.json: 102
.png: 83
.txt: 31
.mkv: 31
.parquet: 30
.jpg: 15
.xlsx: 12
.exe: 1
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The license is marked as other;… See the full description on the dataset page: https://huggingface.co/datasets/xiaoluo11/volcano-princess-gameplay-data.sunain-gameplay
Dataset Summary
Sunain Gameplay is a large-scale multimodal dataset containing synchronized gameplay videos and player input actions from 12 popular video games. The dataset comprises over 1000 curated clips (10-50 seconds each) with 2M+ frames and frame-level action annotations, designed specifically for training embodied AI agents, world models, and video generation systems. This release represents a curated sample of the full Sunain gameplay dataset. For access to the complete… See the full description on the dataset page: https://huggingface.co/datasets/Sunain-Labs/sunain-gameplay.GameplayCaptions
Dataset Card for "Gameplay Captions"
More Information needed
stellar-blade-gameplay-data
剑星
This public dataset repository contains local gameplay data uploaded from F:\剑星.
Contents
Files: 225
Total local size: 167.48 GB
Generated: 2026-06-07 11:56:57 UTC
File Types
.jsonl: 67
.png: 57
.json: 51
.parquet: 17
.mkv: 17
.txt: 16
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The license is marked as other; review game footage, audio, and asset… See the full description on the dataset page: https://huggingface.co/datasets/xiaoluo11/stellar-blade-gameplay-data.cyberpunk-2077-gameplay-data
赛博朋克2077
This public dataset repository contains local gameplay data uploaded from F:\赛博朋克2077.
Contents
Files: 363
Total local size: 130.15 GB
Generated: 2026-06-06 01:12:32 UTC
File Types
.jsonl: 112
.json: 84
.png: 83
.txt: 28
.mkv: 28
.parquet: 27
.jpg: 1
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The license is marked as other; review game… See the full description on the dataset page: https://huggingface.co/datasets/xiaoluo11/cyberpunk-2077-gameplay-data.GameplayCaptions-GPT-4VGameplayCaptions-Gemini-pro-visionBrawlStars-gameplay
Brawl Stars Gameplay Dataset & Models
This repository contains labeled gameplay footage of Brawl Stars, along with trained computer vision models for detection and HP (health points) OCR.
Contents
YOLO Detection Model
best.pt — Trained YOLO model weights (yolo26s architecture). Detects: player, enemy, powercube, powercube-box, wall, water, bush, zone.
from ultralytics import YOLO
model = YOLO("best.pt")
results = model.predict("screenshot.png")… See the full description on the dataset page: https://huggingface.co/datasets/BlackPymer2/BrawlStars-gameplay.thehunter-call-of-the-wild-gameplay-data
猎人荒野的召唤
This public dataset repository contains local gameplay data uploaded from F:\猎人荒野的召唤.
Contents
Files: 99
Total local size: 91.92 GB
Generated: 2026-06-04 00:27:08 UTC
File Types
.jsonl: 28
.png: 27
.json: 23
.txt: 7
.parquet: 7
.mkv: 7
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The license is marked as other; review game footage, audio, and… See the full description on the dataset page: https://huggingface.co/datasets/xiaoluo11/thehunter-call-of-the-wild-gameplay-data.escape-simulator-gameplay-data
密室逃脱模拟器
This public dataset repository contains local gameplay data uploaded from F:\密室逃脱模拟器.
Contents
Files: 211
Total local size: 102.72 GB
Generated: 2026-06-05 02:51:23 UTC
File Types
.jsonl: 62
.png: 52
.json: 49
.mkv: 17
.txt: 16
.parquet: 15
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The license is marked as other; review game footage, audio… See the full description on the dataset page: https://huggingface.co/datasets/xiaoluo11/escape-simulator-gameplay-data.dark-souls-gameplay-data
黑暗之魂
This public dataset repository contains local gameplay data uploaded from F:\黑暗之魂.
Contents
Files: 130
Total local size: 91.70 GB
Generated: 2026-06-03 19:40:50 UTC
File Types
.jsonl: 40
.json: 30
.png: 30
.txt: 10
.parquet: 10
.mkv: 10
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The license is marked as other; review game footage, audio, and… See the full description on the dataset page: https://huggingface.co/datasets/xiaoluo11/dark-souls-gameplay-data.raft-gameplay-data
木筏求生
This public dataset repository contains local gameplay data uploaded from F:\木筏求生.
Contents
Files: 196
Total local size: 150.39 GB
Generated: 2026-06-06 19:00:23 UTC
File Types
.jsonl: 56
.json: 47
.png: 32
.jpg: 16
.txt: 15
.mkv: 15
.parquet: 13
.exe: 2
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The license is marked as other; review game… See the full description on the dataset page: https://huggingface.co/datasets/xiaoluo11/raft-gameplay-data.genshin-gameplay-video-data
Elements
This public dataset repository contains local gameplay data uploaded from /Volumes/Elements.
Contents
Files: 4591
Total local size: 4.08 TB
Generated: 2026-06-06 13:59:13 UTC
File Types
.jsonl: 1379
.png: 1085
.json: 1067
.txt: 351
.mkv: 341
.parquet: 329
[no extension]: 28
.jpg: 10
.mp4: 1
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The… See the full description on the dataset page: https://huggingface.co/datasets/zhiyuanhucs/genshin-gameplay-video-data.GameplayCaptions-GPT-4V-V2Gameplay-Walkthrough-QAstardew-valley-gameplay-data
星露谷物语
This public dataset repository contains local gameplay data uploaded from F:\星露谷物语.
Contents
Files: 453
Total local size: 514.44 GB
Generated: 2026-06-11 23:20:22 UTC
File Types
.jsonl: 139
.json: 111
.png: 81
.txt: 36
.mkv: 34
.parquet: 34
.jpg: 18
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The license is marked as other; review game footage… See the full description on the dataset page: https://huggingface.co/datasets/xiaoluo11/stardew-valley-gameplay-data.assassins-creed-origins-gameplay-data
刺客信条起源
This public dataset repository contains local gameplay data uploaded from F:\刺客信条起源.
Contents
Files: 197
Total local size: 217.26 GB
Generated: 2026-06-07 14:59:11 UTC
File Types
.jsonl: 58
.json: 48
.png: 47
.txt: 15
.mkv: 14
.parquet: 14
.mp4: 1
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The license is marked as other; review game footage… See the full description on the dataset page: https://huggingface.co/datasets/xiaoluo11/assassins-creed-origins-gameplay-data.baldurs-gate-3-gameplay-data
博德之门3
This public dataset repository contains local gameplay data uploaded from F:\博德之门3.
Contents
Files: 162
Total local size: 146.37 GB
Generated: 2026-06-06 10:07:05 UTC
File Types
.jsonl: 48
.png: 42
.json: 36
.txt: 12
.mkv: 12
.parquet: 12
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The license is marked as other; review game footage, audio, and… See the full description on the dataset page: https://huggingface.co/datasets/xiaoluo11/baldurs-gate-3-gameplay-data.no-mans-sky-gameplay-data
无人深空
This public dataset repository contains local gameplay data uploaded from F:\无人深空.
Contents
Files: 105
Total local size: 82.69 GB
Generated: 2026-06-03 15:24:45 UTC
File Types
.png: 28
.jsonl: 28
.json: 21
.txt: 7
.xlsx: 7
.mkv: 7
.parquet: 7
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The license is marked as other; review game footage, audio… See the full description on the dataset page: https://huggingface.co/datasets/xiaoluo11/no-mans-sky-gameplay-data.disco-elysium-gameplay-data
极乐迪斯科
This public dataset repository contains local gameplay data uploaded from F:\极乐迪斯科.
Contents
Files: 143
Total local size: 128.61 GB
Generated: 2026-06-05 18:26:27 UTC
File Types
.jsonl: 44
.json: 33
.png: 33
.txt: 11
.mkv: 11
.parquet: 11
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The license is marked as other; review game footage, audio, and… See the full description on the dataset page: https://huggingface.co/datasets/xiaoluo11/disco-elysium-gameplay-data.retro-games-gameplay-framesvalorant-gameplay-data
瓦罗兰特
This public dataset repository contains local gameplay data uploaded from F:\瓦罗兰特.
Contents
Files: 52
Total local size: 31.32 GB
Generated: 2026-06-03 11:00:35 UTC
File Types
.jsonl: 16
.json: 12
.png: 12
.txt: 4
.parquet: 4
.mkv: 4
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The license is marked as other; review game footage, audio, and asset… See the full description on the dataset page: https://huggingface.co/datasets/xiaoluo11/valorant-gameplay-data.devil-may-cry-5-gameplay-data
鬼泣5
This public dataset repository contains local gameplay data uploaded from F:\鬼泣5.
Contents
Files: 52
Total local size: 37.19 GB
Generated: 2026-06-03 11:20:38 UTC
File Types
.jsonl: 16
.json: 12
.png: 12
.txt: 4
.parquet: 4
.mkv: 4
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The license is marked as other; review game footage, audio, and asset… See the full description on the dataset page: https://huggingface.co/datasets/xiaoluo11/devil-may-cry-5-gameplay-data.Diogenes_Gameplay_raw_sample_v01
Diogenes Gameplay Raw Sample v01
Formerly DiogenesLab/Diogenes_COD_sample_v01 — old links redirect here.
A sample dataset. PC gameplay recordings with frame-aligned keyboard/mouse action
annotations, in two batches:
batch
recorded
video
audio
batch 1
2026-07-25/26
1920×1080 @ 30 fps, H.264
none
batch 2
2026-07-31
1920×1080 @ 60 fps, H.264
process-loopback system audio, 48 kHz stereo s16le (zstd-compressed PCM)
This is a sample — the recording output available… See the full description on the dataset page: https://huggingface.co/datasets/DiogenesLab/Diogenes_Gameplay_raw_sample_v01.the-sims-4-gameplay-data
模拟人生4
This public dataset repository contains local gameplay data uploaded from F:\模拟人生4.
Contents
Files: 98
Total local size: 100.54 GB
Generated: 2026-06-04 21:39:35 UTC
File Types
.jsonl: 30
.json: 23
.png: 21
.txt: 8
.parquet: 8
.mkv: 8
Notes
This repository may contain gameplay video, images, Parquet files, JSON/JSONL metadata, and keyboard/mouse event logs.
The license is marked as other; review game footage, audio, and… See the full description on the dataset page: https://huggingface.co/datasets/xiaoluo11/the-sims-4-gameplay-data.world-model-gameplay-recording
World Model Gameplay Recording
Action-conditioned gameplay video dataset for world model training. Contains synchronized high-resolution gameplay recordings with frame-accurate input action logs (gamepad, keyboard, mouse) from multiple AAA game titles.
Games Included
#
Game
Session ID
Duration
Video Format
Video Size
Input Type
1
Game Session 1
fwa0NekU
~5 min
MKV
582 MB
Gamepad + Keyboard
2
The Legend of Zelda: Tears of the Kingdom
g4qz1DLq
~15 min
MP4… See the full description on the dataset page: https://huggingface.co/datasets/obaydata/world-model-gameplay-recording.gameplay_get_captionsfootsies-gameplay
Footsies Dataset
Game frames from FOOTSIES game.
{episode}_{step}_{p1}_{p2}_{v1}_{v2}.png
can ignore p2, v1 and v2
Dataset Structure
data/train-00000-of-00001.parquet: Metadata
data/images/: PNG frames
Columns
Column
Type
Description
image
str
Path to image file
episode
int
Episode number (0-299)
step
int
Step within episode
p1_action
int
Player 1 action (0=none, 1=back, 2=forward)
p2_action
int
Player 2 action
Statistics… See the full description on the dataset page: https://huggingface.co/datasets/H1yori233/footsies-gameplay.