Datasetpublic

shi-labs/physical-ai-bench-understanding

Physical AI Bench - Understanding PAI-Bench (Physical AI Bench) is a comprehensive benchmark designed to evaluate physical AI generation and understanding capabilities across various real-world scenarios. This particular dataset, PAI-Bench-U, focuses specifically on Video Understanding tasks, comprising 2,808 real-world cases with task-aligned metrics. Paper: PAI-Bench: A Comprehensive Benchmark For Physical AI Code: GitHub Repository Citation If you use… See the full description on the dataset page: https://huggingface.co/datasets/shi-labs/physical-ai-bench-understanding.

sourceHugging Facemitupdated 10mo agoView on Hugging Face

1likes903downloads

Dataset Card

Physical AI Bench - Understanding

PAI-Bench (Physical AI Bench) is a comprehensive benchmark designed to evaluate physical AI generation and understanding capabilities across various real-world scenarios. This particular dataset, PAI-Bench-U, focuses specifically on Video Understanding tasks, comprising 2,808 real-world cases with task-aligned metrics.

—Paper: PAI-Bench: A Comprehensive Benchmark For Physical AI
—Code: GitHub Repository

Citation

If you use Physical AI Bench in your research, please cite:

bibtex

@misc{zhou2025paibenchcomprehensivebenchmarkphysical,
      title={PAI-Bench: A Comprehensive Benchmark For Physical AI}, 
      author={Fengzhe Zhou and Jiannan Huang and Jialuo Li and Deva Ramanan and Humphrey Shi},\
      year={2025},\
      eprint={2512.01989},\
      archivePrefix={arXiv},\
      primaryClass={cs.CV},\
      url={https://arxiv.org/abs/2512.01989}, \
}