EPFL-VILAB/TST-ProcTHOR

Dataset Card for TST-ProcTHOR Dataset Summary This custom TST-ProcTHOR dataset is used in research work "Multimodality as Supervision: Self-Supervised Specialization to the Test Environment via Multimodality". pretrain/ is a multimodal pretraining dataset collected using ProcTHOR environment. It contains RGB images, and 9 additional tokenized modalities. segmentation/train is the associated downstream dataset used to finetune TST pretrained models on semantic… See the full description on the dataset page: https://huggingface.co/datasets/EPFL-VILAB/TST-ProcTHOR.