SITL-Eng/CRCD

Comprehensive Robotic Cholecystectomy Dataset (CRCD)

The Comprehensive Robotic Cholecystectomy Dataset (CRCD) is a large-scale, multimodal dataset for robot-assisted surgery (RAS) research. It provides synchronized endoscopic videos, da Vinci surgical robot kinematics, and pedal usage signals, making it one of the most comprehensive open datasets for studying robotic cholecystectomy procedures.

CRCD supports research in:

• —Medical robotics and surgical automation
• —Computer vision for endoscopic surgery
• —Surgical workflow analysis and phase recognition
• —Instrument tracking and tissue segmentation
• —AI and machine learning in healthcare

Updates

• —Sep 30, 2025: Corrected video timestamps for improved synchronization and cleaned up the dataset for easier use.

Dataset Info

• —Curated by: Ki-Hwan Oh, Leonardo Borgioli, Alberto Mangano, Valentina Valle, Marco Di Pangrazio, Francesco Toti, Gioia Pozza, Luciano Ambrosini, Alvaro Ducas, Miloš Žefran, Liaohai Chen, Pier Cristoforo Giulianotti

Dataset Sources

<table align="center"> <tr> <td><a href="https://github.com/sitleng/CRCD"><img src="https://img.shields.io/badge/GitHub-Repo-blue?logo=github"/></a><br/><b>GitHub</b></td> <td><a href="https://arxiv.org/abs/2412.12238"><img src="https://img.shields.io/badge/arXiv-Paper-red?logo=arxiv"/></a><br/><b>Journal (Expanded)</b></td> <td><a href="https://ieeexplore.ieee.org/abstract/document/10585836"><img src="https://img.shields.io/badge/IEEE-Paper-blue?logo=ieee"/></a><br/><b>Conference Paper</b></td> </tr> </table>

• —Raw Dataset: Endoscopic videos, da Vinci kinematics, and console pedal usage (link)
• —Annotated Dataset: Frames with annotated tissue segmentation and instrument keypoints (link)
• —Additional Information: Stereo endoscopic camera calibration and surgeon background data (link)

Dataset Creation

CRCD was collected during robotic cholecystectomy procedures performed on the da Vinci surgical system. Each case includes:

• —High-resolution endoscopic video
• —Robot kinematic data (ECM, MTML, MTMR, PSM1, PSM2)
• —Surgeon pedal signals (clutch, camera, monopolar, bipolar)

Several surgeons with different levels of expertise participated, enabling research on skill assessment, workflow modeling, and training.

License

This dataset is licensed under the Creative Commons Attribution 4.0 International License.

Citation

If you use CRCD, please cite:

@INPROCEEDINGS{oh2024crcd,
  author={Oh, Ki-Hwan and Borgioli, Leonardo and Mangano, Alberto and Valle, Valentina and Di Pangrazio, Marco and Toti, Francesco and Pozza, Gioia and Ambrosini, Luciano and Ducas, Alvaro and Žefran, Miloš and Chen, Liaohai and Giulianotti, Pier Cristoforo},
  booktitle={2024 International Symposium on Medical Robotics (ISMR)}, 
  title={Comprehensive Robotic Cholecystectomy Dataset (CRCD): Integrating Kinematics, Pedal Signals, and Endoscopic Videos}, 
  year={2024},
  pages={1-7},
  doi={10.1109/ISMR63436.2024.10585836}
}

@article{oh2024crcdexpanded,
  author = {Oh, Ki-Hwan and Borgioli, Leonardo and Mangano, Alberto and Valle, Valentina and Pangrazio, Marco Di and Toti, Francesco and Pozza, Gioia and Ambrosini, Luciano and Ducas, Alvaro and Žefran, Miloš and Chen, Liaohai and Giulianotti, Pier Cristoforo},
  title = {Expanded Comprehensive Robotic Cholecystectomy Dataset},
  journal = {Journal of Medical Robotics Research},
  doi = {10.1142/S2424905X25500060},
  URL = {https://doi.org/10.1142/S2424905X25500060}
}