CoolFace
Datasetpublic

Nahrawy/VIDIT-Depth-ControlNet

VIDIT Dataset This is a version of the VIDIT dataset equipped for training ControlNet using depth maps conditioning. VIDIT includes 390 different Unreal Engine scenes, each captured with 40 illumination settings, resulting in 15,600 images. The illumination settings are all the combinations of 5 color temperatures (2500K, 3500K, 4500K, 5500K and 6500K) and 8 light directions (N, NE, E, SE, S, SW, W, NW). Original image resolution is 1024x1024. We include in this version only the… See the full description on the dataset page: https://huggingface.co/datasets/Nahrawy/VIDIT-Depth-ControlNet.

sourceHugging Faceupdated 3y agoView on Hugging Face
10likes1kdownloads
README.md38 linesDownload Raw Back to root
1---2dataset_info:3  features:4  - name: scene5    dtype: string6  - name: image7    dtype: image8  - name: depth_map9    dtype: image10  - name: direction11    dtype: string12  - name: temprature13    dtype: int3214  - name: caption15    dtype: string16  splits:17  - name: train18    num_bytes: 20575644792.019    num_examples: 1200020  download_size: 2010843128021  dataset_size: 20575644792.022---23# VIDIT Dataset24This is a version of the [VIDIT dataset](https://github.com/majedelhelou/VIDIT) equipped for training ControlNet using depth maps conditioning.25VIDIT includes 390 different Unreal Engine scenes, each captured with 40 illumination settings, resulting in 15,600 images. The illumination settings are all the combinations of 5 color temperatures (2500K, 3500K, 4500K, 5500K and 6500K) and 8 light directions (N, NE, E, SE, S, SW, W, NW). Original image resolution is 1024x1024.26We include in this version only the training split containing only 300 scenes.27Captions were generated using the [BLIP-2, Flan T5-xxl](https://huggingface.co/Salesforce/blip2-flan-t5-xxl) model.28Depth maps were generated using the [GLPN fine-tuned on NYUv2 ](https://huggingface.co/vinvino02/glpn-nyu) model.29 30## Examples with varying direction31![varying direction](B_directions.gif)32## Examples with varying color temperature33![varying color temperature](B_illuminants.gif)34 35## Disclaimer36I do not own any of this data.37 38