video-llm
Grounded-VideoLLMVideo-3D-LLM_data
Data Preparation
Preprocessing
The directory should be orgainized as
Video-3D-LLM # project root
├── data
│ ├── scannet
│ │ ├── scans
│ │ ├── posed_images
│ │ ├── pcd_with_object_aabbs
│ │ └── mask
│ ├── embodiedscan
│ │ ├── embodiedscan_infos_train.pkl
│ │ ├── embodiedscan_infos_val.pkl
│ │ └── embodiedscan_infos_test.pkl
│ ├── metadata
│ │ ├── scannet_select_frames.json
│ │ ├── pcd_discrete_0.1.pkl
│ │ ├──… See the full description on the dataset page: https://huggingface.co/datasets/zd11024/Video-3D-LLM_data.svbrd-llm-roadside-video-avvideollm-online-chat-ego4d-134k
videollm-online-chat-134k
Introduction
This is the dataset proposed in CVPR 2024 paper: VideoLLM-online: Online Video Large Language Model for Streaming Video. Visit our homepage for paper, demo, code, etc.
The datasets contain 113k streaming narration data and 21k (generated) streaming free-form dialogue data.
The streaming narration data is derived from Ego4D narration, but we cleaned and rephrased them with Llama-3, so that the narration text will not contain strange… See the full description on the dataset page: https://huggingface.co/datasets/chenjoya/videollm-online-chat-ego4d-134k.grounded-videollm-activitynetVideoLLM-BoE
VideoLLM-BoE
VideoLLM-BoE contains four benchmarks for evaluating Bag-of-Events behavior in
video large language models. Source code is available in the
GitHub repository.
Dataset contents
Path
Contents
concat-easy/
450 videos and 2,700 questions
concat-hard/
450 videos and 2,700 questions
injected-ads/data.csv
256 examples with questions and MLVU/AdsQA source pairings
natural-ads/data.csv
150 examples with video links, questions, and ad… See the full description on the dataset page: https://huggingface.co/datasets/lab-flair/VideoLLM-BoE.