datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Kairos_AFEIThe AFEI Corpus: Holonic Scarcity Dynamics & The Shadow Lineage
By Sebastiaan van der Heide (Unityinsight / Kairos_AFEI)
===
The AFEI Corpus and the AFEI Research Methodology are meant to be used to analyze societal and institutional dynamics, with a particular focus on institutional iatrogenesis, epistemic entrapment and epistemic entrainment.
===
AFEI Origins:
The following commits contain descriptions and files which show the entire creation and operational blueprint of the AFEI Methodology… See the full description on the dataset page: https://huggingface.co/datasets/Unityinsight/Kairos_AFEI.causal-gpt-rl-unity-envs
Causal GPT-RL — Unity ML-Agents environments
Public materials for running Causal GPT-RL policies in Unity ML-Agents. Each
environment is a model-removed Unity build — the engine binary with no
baked-in policy; the policy is supplied at run time. All eight environments are
paired with their stock built-in policies, and the four discrete-action ones
additionally ship a logits-exposing variant under tier_policies/.
Builds are published for Windows x86-64 and, under linux/, for… See the full description on the dataset page: https://huggingface.co/datasets/ccnets/causal-gpt-rl-unity-envs.seer_unityUnityShotsBench
UnityShots Benchmark
A multilingual, multi-cultural k-shot storytelling benchmark for evaluating multi-shot
audio-video generation. Each case is a short cinematic story told across several shots, with a
consistent cast whose identity, voice, and world must persist across every cut.
This is the evaluation benchmark released with UnityShots: Memory-Driven Multi-Shot
Audio-Video Generation with Boundary-Aware Gating.
📄 Paper: arXiv:2606.21661
🌐 Project page:… See the full description on the dataset page: https://huggingface.co/datasets/KlingTeam/UnityShotsBench.UnityShotsBench
UnityShots Benchmark
A multilingual, multi-cultural k-shot storytelling benchmark for evaluating multi-shot
audio-video generation. Each case is a short cinematic story told across several shots, with a
consistent cast whose identity, voice, and world must persist across every cut.
This is the evaluation benchmark released with UnityShots: Memory-Driven Multi-Shot
Audio-Video Generation with Boundary-Aware Gating.
📄 Paper: arXiv:2606.21661
🌐 Project page:… See the full description on the dataset page: https://huggingface.co/datasets/zxc0135/UnityShotsBench.unity_pick_place_v2This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "unity_robot",
"total_episodes": 50,
"total_frames": 7556,
"total_tasks": 1,
"total_videos": 0,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 10,
"splits": {
"train": "0:50"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/ddari/unity_pick_place_v2.UnityWizardsModelCollectionTHIS DATASET CONTAINS MODELS THAT ARE NOT COMPATIBLE WITH DRAW THINGS.
YOU CAN FIND DRAW THINGS COMPATIBLE VERSIONS INSIDE "DT" FOLDER INSIDE EACH MODEL IN THE DATASET :)
mesh_cut_unityThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "unity",
"total_episodes": 54,
"total_frames": 36308,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 10,
"splits": {
"train": "0:54"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/MauoSama/mesh_cut_unity.ctcr_unity_rgb_seg_xyz_relativeThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "unity",
"total_episodes": 75,
"total_frames": 62176,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 20,
"splits": {
"train": "0:75"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/JackySunUofT/ctcr_unity_rgb_seg_xyz_relative.causal-gpt-rl-unity-datasets
Causal GPT-RL — Unity ML-Agents trajectories
Recorded Unity ML-Agents trajectories packaged as
Minari datasets — offline-RL datasets spanning
continuous and discrete action spaces. Any offline-RL method can train on them; we
built them to develop Causal GPT-RL, our new approach that works across both
space types. All eight environments ship an expert tier and a full
quality ladder (expert + calibrated medium/simple) synthesized by
degrading the stock policy — Gaussian… See the full description on the dataset page: https://huggingface.co/datasets/ccnets/causal-gpt-rl-unity-datasets.code25pile75_shuffle_filtered_unity3d_dedupunitylerobotunity_pick_place_v4This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v2.1",
"robot_type": "unity_robot",
"total_episodes": 200,
"total_frames": 20244,
"total_tasks": 1,
"total_videos": 0,
"total_chunks": 1,
"chunks_size": 1000,
"fps": 10,
"splits": {
"train": "0:200"
},
"data_path": "data/chunk-{episode_chunk:03d}/episode_{episode_index:06d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/ddari/unity_pick_place_v4.unitylerobot0423unity-dev-instructions
Unity Developer Instructions
A comprehensive instruction-tuning dataset for Unity game development,
covering C# scripting, XR/VR development, physics, animation, rendering,
UI Toolkit, and performance optimization.
Dataset Summary
Split
Count
Train
46,483
Test
2,446
Total
48,929
Data Sources
| unity_docs | 40,496 |
| stackoverflow | 6,071 |
| github | 2,362 |
Source breakdown:
Source
Count
unity_docs
40,496
stackoverflow
6,071… See the full description on the dataset page: https://huggingface.co/datasets/vishnuOI/unity-dev-instructions.Unity-NorthStarctcr_unity_liquid_rgb_segThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "unity",
"total_episodes": 75,
"total_frames": 62176,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 20,
"splits": {
"train": "0:75"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/JackySunUofT/ctcr_unity_liquid_rgb_seg.my-unity-assetsgeometric-unity-physics
Geometric Unity — Advanced Physics Dataset
Matt Gibson · Crimson OS / Crimson Symphony MediaCA benchmark: independent Poole-manifold simulation (reference experiment, not co-authorship)License: Apache 2.0 · Repo: https://github.com/ultranetcommand-neo/Crimson-OSCompanion datasets: crimson-os-monoliths · crimson-os-canon
Reproducible physics register for the Logos geometric anchor — F₂ ↪ SO(3), cos θ = ⅓ — with monolith derivations, JHTDB turbulence ablation artifacts, and… See the full description on the dataset page: https://huggingface.co/datasets/UltranetCommand/geometric-unity-physics.glm-5.3-flash-arc-agi-3-expert-usage
GLM-5.3-Flash — per-layer MoE expert usage on ARC-AGI-3
Per-layer, per-expert routing counts collected while GLM-5.3-Flash (320B total /
18B active) played the 25 public official ARC-AGI-3 games through the TUFA
duck-harness (TAAF).
Collected by instrumenting vLLM's FusedMoERouter.select_experts and accumulating a
[MoE layer x expert] count matrix on-GPU.
Model / run configuration
model
zai-org/GLM-5.3-Flash (FP8)
serving
vLLM (ROCm)… See the full description on the dataset page: https://huggingface.co/datasets/unity4ar/glm-5.3-flash-arc-agi-3-expert-usage.unity_api_2022_3
Unity3d 2022.3 LTS API & Manual
In this dataset, you'll find a series of Q&A for the Unity3d API and Manual.
Dataset Creation
Download the unity offline documentation.
Process documentation, extract title, and description. Clean documentation.
Process each title and description item in llama3-8B-Instruct in order to generate several questions that capture the meaning of the API.
Re-process in llama3-8B-Instruct with question and API to generate the answer.… See the full description on the dataset page: https://huggingface.co/datasets/Hypersniper/unity_api_2022_3.ctcr_unity_c1_rgb_seg_depth_100This dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "unity",
"total_episodes": 100,
"total_frames": 22929,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 200,
"fps": 15,
"splits": {
"train": "0:100"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/JackySunUofT/ctcr_unity_c1_rgb_seg_depth_100.Unity-Engine-CSharp-Code-and-Game-Design-Document-Code-Pairs-Mix-and-Jam
Unity Code and GPT-Generated GDD Pairs Dataset
This dataset contains paired samples of Unity game mechanic scripts and their corresponding GPT-4 generated Game Design Documents (GDDs). It is intended for training and benchmarking LLMs in game code generation from design specifications.
Format
Each entry is stored as a .jsonl file with:
"input": GPT-4 generated GDD describing a specific game and its mechanics
"output": Unity C# scripts implementing the described mechanic… See the full description on the dataset page: https://huggingface.co/datasets/AmnaHassan/Unity-Engine-CSharp-Code-and-Game-Design-Document-Code-Pairs-Mix-and-Jam.mesh_cut_unity_wristThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "unity",
"total_episodes": 54,
"total_frames": 36308,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 10,
"splits": {
"train": "0:54"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/MauoSama/mesh_cut_unity_wrist.mesh_cut_unity_staticThis dataset was created using LeRobot.
Dataset Structure
meta/info.json:
{
"codebase_version": "v3.0",
"robot_type": "unity",
"total_episodes": 54,
"total_frames": 36308,
"total_tasks": 1,
"chunks_size": 1000,
"data_files_size_in_mb": 100,
"video_files_size_in_mb": 500,
"fps": 10,
"splits": {
"train": "0:54"
},
"data_path": "data/chunk-{chunk_index:03d}/file-{file_index:03d}.parquet",
"video_path":… See the full description on the dataset page: https://huggingface.co/datasets/MauoSama/mesh_cut_unity_static.pub-instruct-unity.preview
Pub-Instruct — Unity (Preview)
An open, license-respecting instruction-tuning dataset for Unity 6 (6000.0 LTS) C# development.
Records are generated clean-room by an open-weight model and validated by compiling every code
sample against pinned Unity 6 reference assemblies.
⚠️ Preview — 3,247 records at ~36% of planned coverage. This early cut is foundations-first
(Unity official docs, an OER textbook, and MIT-0 CatLikeCoding tutorials are well covered); applied… See the full description on the dataset page: https://huggingface.co/datasets/wrayy/pub-instruct-unity.preview.Unity_ResolvedQuestions
Unity Resolved Questions Dataset
This dataset contains curated Unity-related technical Q&A pairs, focused on practical problem-solving in Unity, C#, XR, URP/HDRP, and SketchUp.
Data Formats
data/hermes.jsonInstruction-style format (instruction, input, output), suitable for base / completion-style SFT.
data/messages.jsonlChat-style format (system, user, assistant), designed for instruction-following and chat models such as Mistral Instruct v0.3.
Intended Use… See the full description on the dataset page: https://huggingface.co/datasets/Erocal/Unity_ResolvedQuestions.unity_dataset
A dataset generated using a phospho dev kit
This dataset was generated using a phospho dev kit. It contains a series of episodes recorded with a robot and multiple cameras.
It can be directly used to train a policy using imitation learning.
It's compatible with LeRobot and RLDS.
neuronav-dp-r14-unity
NeuroNav R14 Unity player and eight maps
Linux x86_64 Unity player tree used for real R14 navigation rollout, plus the
eight fixed evaluation map PNGs. Crash dumps and desktop metadata are excluded;
runtime files are hash listed in manifest.json.
unity-demos
Unity Demos 🎮
This dataset contains the Unity demos for the ML for Games course
The course's link 👉 https://huggingface.co/learn/ml-games-course/unit0/introduction