CoolFace
Datasetpublic

simplexsigil2/omnifall

OmniFall: A Unified Benchmark for Staged-to-Wild Fall Detection OmniFall is a comprehensive fall detection benchmark with dense temporal segment annotations across three components: OF-Staged (8 public lab datasets), OF-In-the-Wild (genuine accidents from OOPS), and OF-Synthetic (12,000 diffusion-generated videos with demographic diversity). All components share a sixteen-class activity taxonomy. [Paper] [Project Page] Quickstart… See the full description on the dataset page: https://huggingface.co/datasets/simplexsigil2/omnifall.

sourceHugging Facecc-by-nc-4.0updated 25d agoView on Hugging Face
10likes2kdownloads
Dataset Card

![License: CC BY-NC-SA 4.0](https://creativecommons.org/licenses/by-nc-sa/4.0/) </br> <a href="https://arxiv.org/abs/2505.19889"> <img src="https://img.shields.io/badge/arXiv-2505.19889-b31b1b.svg?logo=arXiv" alt="arXiv" style="height:20px;"> </a> </br> <a href="https://simplexsigil.github.io/omnifall/"> <img src="https://img.shields.io/badge/Omnifall-ProjectPage-2FA7C9.svg" alt="Project Page" style="height:20px;"> </a> </br> <a href="https://pypi.org/project/omnifall/"> <img src="https://img.shields.io/badge/Omnifall-PythonPackage-006EAE.svg" alt="Python Package" style="height:20px;"> </a>

OmniFall: A Unified Benchmark for Staged-to-Wild Fall Detection

OmniFall is a comprehensive fall detection benchmark with dense temporal segment annotations across three components: OF-Staged (8 public lab datasets), OF-In-the-Wild (genuine accidents from OOPS), and OF-Synthetic (12,000 diffusion-generated videos with demographic diversity). All components share a sixteen-class activity taxonomy.

[[Paper]](https://arxiv.org/abs/2505.19889) [[Project Page]](https://simplexsigil.github.io/omnifall/)

Quickstart

Labels only (no video files needed)

python
from datasets import load_dataset

# 8 staged datasets, cross-subject split
ds = load_dataset("simplexsigil2/omnifall", "of-sta-cs")
print(ds["train"][0])  # {'path': ..., 'label': 1, 'start': 0.0, 'end': 2.5, ...}

# Cross-domain: train on staged, test on all (staged + itw + syn)
ds = load_dataset("simplexsigil2/omnifall", "of-sta-to-all-cs")

# Synthetic data with demographic metadata (19 columns)
ds = load_dataset("simplexsigil2/omnifall", "of-syn")

With video loading (pip install omnifall)

python
import omnifall

# OF-Syn videos auto-download from HF Hub (~9.1GB, cached)
ds = omnifall.load("of-syn", video=True)

# OF-ItW requires one-time OOPS video preparation
omnifall.prepare_oops()  # streams ~45GB, extracts ~2.6GB
ds = omnifall.load("of-itw", video=True)

# The video column contains absolute file paths (strings)
print(ds["train"][0]["video"])

Video paths can also be added to an already-loaded dataset via omnifall.add_video(ds, config="of-syn"). OOPS preparation is also available via CLI: omnifall prepare-oops.

Loading the data directly? STRUCTURE.md explains how a label row resolves to a video file and which videos each component contributes; KNOWN_PITFALLS.md covers the two things that can catch you out. The omnifall package handles both for you.

Overview

VideosSegments (SV)Duration (SV)
OF-Staged (8 datasets)2,1649,59013.81h
OF-ItW (OOPS)8184,0222.65h
OF-Syn12,00019,22816.88h
Total14,98232,84033.34h
DatasetTypeVideosSegments (SV)Duration (SV)Avg Seg (s)
CMDFallmulti (7 views)3846,0267.12h4.25
UP-Fallmulti (2 views)1,1181,2134.59h13.63
Le2isingle1909670.79h2.95
GMDCSA24single1604580.36h2.80
CAUCAFallsingle1002580.28h3.85
EDFmulti (2 views)102540.22h3.14
OCCUmulti (2 views)102450.25h3.54
MCFDmulti (8 views)1921690.20h4.26
OOPS-Fallsingle8184,0222.65h2.38
OF-Synsingle12,00019,22816.88h3.16

SV = single-view (one count per unique camera perspective). Multi-view datasets have additional synchronized views; see statistics.md for full multi-view counts and class distributions.

Configs

Over 70 configurations are available. Each returns train/validation/test splits.

CategoryExamplesDescription
Same-domainof-sta-cs, of-sta-cv, of-itw, of-synTrain and test from the same source
Cross-domain (to-all)of-sta-to-all-cs, of-syn-to-all-csTrain on one source, test on all (staged + ItW + Syn)
Individual to-allcmdfall-to-all-cs, edf-to-all-cvTrain on single dataset, test on all
OF-Syn demographicof-syn-cross-age, of-syn-cross-bmiCross-demographic generalization splits
Aggregatecs, cvAll staged + OOPS combined
Individualcmdfall-cs, le2i-cvSingle staged dataset
Labels/metadatalabels, labels-syn, framewise-synRaw annotations without splits

See CONFIGS.md for the complete configuration reference including deprecated names.

Citation

If you use OmniFall in your research, please cite our paper as well as the sub-dataset papers:

bibtex
@misc{omnifall,
      title={OmniFall: From Staged Through Synthetic to Wild, A Unified Multi-Domain Dataset for Robust Fall Detection},
      author={David Schneider and Zdravko Marinov and Rafael Baur and Zeyun Zhong and Rodi Düger and Rainer Stiefelhagen},
      year={2025},
      eprint={2505.19889},
      archivePrefix={arXiv},
      primaryClass={cs.CV},
      url={https://arxiv.org/abs/2505.19889},
},

@inproceedings{omnifall_cmdfall,
  title={A multi-modal multi-view dataset for human fall analysis and preliminary investigation on modality},
  author={Tran, Thanh-Hai and Le, Thi-Lan and Pham, Dinh-Tan and Hoang, Van-Nam and Khong, Van-Minh and Tran, Quoc-Toan and Nguyen, Thai-Son and Pham, Cuong},
  booktitle={2018 24th International Conference on Pattern Recognition (ICPR)},
  pages={1947--1952},
  year={2018},
  organization={IEEE}
},

@article{omnifall_up-fall,
  title={UP-fall detection dataset: A multimodal approach},
  author={Mart{\'\i}nez-Villase{\~n}or, Lourdes and Ponce, Hiram and Brieva, Jorge and Moya-Albor, Ernesto and N{\'u}{\~n}ez-Mart{\'\i}nez, Jos{\'e} and Pe{\~n}afort-Asturiano, Carlos},
  journal={Sensors},
  volume={19},
  number={9},
  pages={1988},
  year={2019},
  publisher={MDPI}
},

@article{omnifall_le2i,
  title={Optimized spatio-temporal descriptors for real-time fall detection: comparison of support vector machine and Adaboost-based classification},
  author={Charfi, Imen and Miteran, Johel and Dubois, Julien and Atri, Mohamed and Tourki, Rached},
  journal={Journal of Electronic Imaging},
  volume={22},
  number={4},
  pages={041106--041106},
  year={2013},
  publisher={Society of Photo-Optical Instrumentation Engineers}
},

@article{omnifall_gmdcsa,
  title={GMDCSA-24: A dataset for human fall detection in videos},
  author={Alam, Ekram and Sufian, Abu and Dutta, Paramartha and Leo, Marco and Hameed, Ibrahim A},
  journal={Data in Brief},
  volume={57},
  pages={110892},
  year={2024},
  publisher={Elsevier}
},

@article{omnifall_cauca,
  title={Dataset CAUCAFall},
  author={Eraso, Jose Camilo and Mu{\~n}oz, Elena and Mu{\~n}oz, Mariela and Pinto, Jesus},
  journal={Mendeley Data},
  volume={4},
  year={2022}
},

@inproceedings{omnifall_edf_occu,
  title={Evaluating depth-based computer vision methods for fall detection under occlusions},
  author={Zhang, Zhong and Conly, Christopher and Athitsos, Vassilis},
  booktitle={International symposium on visual computing},
  pages={196--207},
  year={2014},
  organization={Springer}
},

@article{omnifall_mcfd,
  title={Multiple cameras fall dataset},
  author={Auvinet, Edouard and Rougier, Caroline and Meunier, Jean and St-Arnaud, Alain and Rousseau, Jacqueline},
  journal={DIRO-Universit{\'e} de Montr{\'e}al, Tech. Rep},
  volume={1350},
  pages={24},
  year={2010}
},

@inproceedings{omnifall_oops,
  title={Oops! predicting unintentional action in video},
  author={Epstein, Dave and Chen, Boyuan and Vondrick, Carl},
  booktitle={Proceedings of the IEEE/CVF conference on computer vision and pattern recognition},
  pages={919--929},
  year={2020}
}

License

The annotations and split definitions are released under CC BY-NC-SA 4.0. The original video data belongs to their respective owners and should be obtained from the original sources.

Contact

For questions about the dataset, please contact [david.schneider@kit.edu].

Documentation

  • statistics.md - Full dataset statistics and class distributions
  • CONFIGS.md - Complete configuration reference and deprecated names
  • STRUCTURE.md - Repository structure and data formats
  • LABELS.md - Label definitions and annotation guidelines
  • KNOWN_PITFALLS.md - Things that surprise people writing their own loader, and what to do about them
  • omnifall_dataset_examples.ipynb - Interactive examples with video loading and visualization