Adaptation of Surgical Activity Recognition Models Across Operating Rooms
Automatic surgical activity recognition enables more intelligent surgical devices and a more efficient workflow. Integration of such technology in new operating rooms has the potential to improve care delivery to patients and decrease costs. Recent works have achieved a promising performance on surgical activity recognition; however, the lack of generalizability of these models is one of the critical barriers to the wide-scale adoption of this technology. In this work, we study the generalizability of surgical activity recognition models across operating rooms. We propose a new domain adaptation method to improve the performance of the surgical activity recognition model in a new operating room for which we only have unlabeled videos. Our approach generates pseudo labels for unlabeled video clips that it is confident about and trains the model on the augmented version of the clips. We extend our method to a semi-supervised domain adaptation setting where a small portion of the target domain is also labeled. In our experiments, our proposed method consistently outperforms the baselines on a dataset of more than 480 long surgical videos collected from two operating rooms.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity RecognitionDomain AdaptationSemi-supervised Domain AdaptationSimilar Papers 제목 키워드 기반
An Empirical Study on Activity Recognition in Long Surgical Videos
Activity recognition in surgical videos is a key research area for developing next-generation devices and workflow monitoring systems. Since surgeries are long processes with highly-variable lengths, deep learning models…
Action DetectionActivity DetectionActivity RecognitionDomain Adaptation+1ST(OR)2: Spatio-Temporal Object Level Reasoning for Activity Recognition in the Operating Room
Surgical robotics holds much promise for improving patient safety and clinician experience in the Operating Room (OR). However, it also comes with new challenges, requiring strong team coordination and effective OR manag…
Action ClassificationActivity RecognitionLong-video Activity RecognitionManagement+1Multi-view Video-Pose Pretraining for Operating Room Surgical Activity Recognition
Understanding the workflow of surgical procedures in complex operating rooms requires a deep understanding of the interactions between clinicians and their environment. Surgical activity recognition (SAR) is a key comput…
Activity RecognitionAutomatic Operating Room Surgical Activity Recognition for Robot-Assisted Surgery
Automatic recognition of surgical activities in the operating room (OR) is a key technology for creating next generation intelligent surgical devices and workflow monitoring/support systems. Such systems can potentially …
Action RecognitionActivity RecognitionCholecTriplet2021: A benchmark challenge for surgical action triplet recognition
Context-aware decision support in the operating room can foster surgical safety and efficiency by leveraging real-time feedback from surgical workflow analysis. Most existing works recognize surgical activities at a coar…
Action DetectionAction Triplet RecognitionActivity RecognitionTriplet