pranked03/ViDAS

ViDAS Dataset

Abstract

We present a novel dataset aimed at advancing danger analysis and assessment by addressing the challenge of quantifying danger in video content and identifying how human-like a Large Language Model (LLM) evaluator is for the same. This is achieved by compiling a collection of 100 YouTube videos featuring various events. Each video is annotated by human participants who provided danger ratings on a scale from 0 (no danger to humans) to 10 (life-threatening), with precise timestamps indicating moments of heightened danger. Additionally, we leverage LLMs to independently assess the danger levels in these videos using video summaries. We introduce Mean Squared Error (MSE) scores for multimodal meta-evaluation of the alignment between human and LLM danger assessments. Our dataset not only contributes a new resource for danger assessment in video content but also demonstrates the potential of LLMs in achieving human-like evaluations.

How to download and use this dataset

The below code will download the metadata with the filenames, danger rating, and temporal coordinates.

from datasets import load_dataset

dataset = load_dataset("pranked03/ViDAS")

The below code will download the videos which can then be accessed using libraries like OpenCV.

i = 0 # Could be value between 0 and 99 (100 videos).

from huggingface_hub import hf_hub_download

file_path = hf_hub_download(
    repo_id="pranked03/ViDAS", filename=dataset["train"][i]["video_id"], repo_type="dataset"
)

Use OpenCV to load the video and display

import cv2

# Load the video file using OpenCV
cap = cv2.VideoCapture(file_path)

# Check if the video was successfully opened
if not cap.isOpened():
    print("Error: Could not open video.")
    exit()

# Read and display video frames
while True:
    ret, frame = cap.read()
    if not ret:
        break

    cv2.imshow('Video', frame)

    # Press 'q' to exit the video window
    if cv2.waitKey(25) & 0xFF == ord('q'):
        break

# Release video capture and close windows
cap.release()
cv2.destroyAllWindows()

Cite us in your work

@misc{gupta2024vidasvisionbaseddangerassessment,
      title={ViDAS: Vision-based Danger Assessment and Scoring}, 
      author={Pranav Gupta and Advith Krishnan and Naman Nanda and Ananth Eswar and Deeksha Agarwal and Pratham Gohil and Pratyush Goel},
      year={2024},
      eprint={2410.00477},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2410.00477}, 
}