Knowledge transfer for surgical activity prediction
Lack of training data hinders automatic recognition and prediction of surgical activities necessary for situation-aware operating rooms. We propose using knowledge transfer to compensate for data deficit and improve prediction. We used two approaches to extract and transfer surgical process knowledge. First, we encoded semantic information about surgical terms using word embedding which boosted learning process. Secondly, we passed knowledge between different clinical datasets of neurosurgical procedures using transfer learning. Transfer learning was shown to be more effective than a simple combination of data, especially for less similar procedures. The combination of two methods provided 22% improvement of activity prediction. We also made several pertinent observations about surgical practices.
Code (0)
등록된 구현이 없습니다.
Tasks
Activity PredictionPredictionTransfer LearningSimilar Papers 제목 키워드 기반
Deep learning-enabled prediction of surgical errors during cataract surgery: from simulation to real-world application
Real-time prediction of technical errors from cataract surgical videos can be highly beneficial, particularly for telementoring, which involves remote guidance and mentoring through digital platforms. However, the rarity…
Domain AdaptationPredictionUnsupervised Domain AdaptationMulti-view Video-Pose Pretraining for Operating Room Surgical Activity Recognition
Understanding the workflow of surgical procedures in complex operating rooms requires a deep understanding of the interactions between clinicians and their environment. Surgical activity recognition (SAR) is a key comput…
Activity RecognitionRecognition and Prediction of Surgical Gestures and Trajectories Using Transformer Models in Robot-Assisted Surgery
Surgical activity recognition and prediction can help provide important context in many Robot-Assisted Surgery (RAS) applications, for example, surgical progress monitoring and estimation, surgical skill evaluation, and …
Activity RecognitionGesture RecognitionPredictionTrajectory PredictionTowards Generalizable Surgical Activity Recognition Using Spatial Temporal Graph Convolutional Networks
Modeling and recognition of surgical activities poses an interesting research problem. Although a number of recent works studied automatic recognition of surgical activities, generalizability of these works across differ…
Activity RecognitionGesture RecognitionSurgical Gesture RecognitionHuman Gaze Guided Attention for Surgical Activity Recognition
Modeling and automatically recognizing surgical activities are fundamental steps toward automation in surgery and play important roles in providing timely feedback to surgeons. Accurately recognizing surgical activities …
Activity RecognitionVideo Understanding