datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
hypersim-episodes-v3-parquet
hypersim-episodes-v3-parquet
Per-frame Parquet dataset for ReCAST tracker training.
Schema
One row per frame, grouped by episode_id. Arrow memory-mapped access
enables reading specific frames without loading entire episodes.
Column
Type
Description
episode_id
int32
Episode identifier
frame_idx
int32
Frame index within episode
jpeg
binary
JPEG-encoded RGB frame
depth
list<float32>
Flat H×W depth map
seg
list<uint16>
Semantic segmentation (empty if… See the full description on the dataset page: https://huggingface.co/datasets/OSResight/hypersim-episodes-v3-parquet.layout_diffusion_hypersimThis repository contains the data for SceneCraft: Layout-Guided 3D Scene Generation.
Project page: https://orangesodahub.github.io/SceneCraft
Code: https://github.com/OrangeSodahub/SceneCraft
hypersim-mini
Hypersim Minimal (RGB + Semantic Mapped)
This dataset is a minimal extraction from Hypersim:
RGB: preview (either preview JPGs or HDR color.hdf5 tonemapped to PNG)
Semantic labels: mapped to uint8 PNG using clip40to39
Columns
image — RGB image
mask — segmentation mask (uint8)
scene, camera, frame — identifiers
Splits
train
validation (ratio: 0.1)
Note: You are responsible for complying with the original Hypersim license/terms.
hypersim_big
Hypersim Minimal (RGB + Semantic Mapped)
This dataset is a minimal extraction from Hypersim:
RGB: preview (either preview JPGs or HDR color.hdf5 tonemapped to PNG)
Semantic labels: mapped to uint8 PNG using clip40to39
Columns
image — RGB image
mask — segmentation mask (uint8)
scene, camera, frame — identifiers
Splits
train
validation (ratio: 0.1)
Note: You are responsible for complying with the original Hypersim license/terms.
Hypersim-SpatialLMHypersim_float32_20250222