Tool and Phase recognition using contextual CNN features
A transfer learning method for generating features suitable for surgical tools and phase recognition from the ImageNet classification features [1] is proposed here. In addition, methods are developed for generating contextual features and combining them with time series analysis for final classification using multi-class random forest. The proposed pipeline is tested over the training and testing datasets of M2CAI16 challenges: tool and phase detection. Encouraging results are obtained by leave-one-out cross validation evaluation on the training dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationTime SeriesTime Series AnalysisTransfer LearningSimilar Papers 제목 키워드 기반
EndoNet: A Deep Architecture for Recognition Tasks on Laparoscopic Videos
Surgical workflow recognition has numerous potential medical applications, such as the automatic indexing of surgical video databases and the optimization of real-time operating room scheduling, among others. As a result…
Offline surgical phase recognitionOnline surgical phase recognitionSchedulingSurgical tool detectionLoViT: Long Video Transformer for Surgical Phase Recognition
Online surgical phase recognition plays a significant role towards building contextual tools that could quantify performance and oversee the execution of surgical workflows. Current approaches are limited since they trai…
Online surgical phase recognitionSurgical phase recognitionTUNeS: A Temporal U-Net with Self-Attention for Video-based Surgical Phase Recognition
Objective: To enable context-aware computer assistance in the operating room of the future, cognitive systems need to understand automatically which surgical phase is being performed by the medical team. The primary sour…
Surgical phase recognitionPitVQA: Image-grounded Text Embedding LLM for Visual Question Answering in Pituitary Surgery
Visual Question Answering (VQA) within the surgical domain, utilizing Large Language Models (LLMs), offers a distinct opportunity to improve intra-operative decision-making and facilitate intuitive surgeon-AI interaction…
Question AnsweringVisual Question AnsweringVisual Question Answering (VQA)Deep Learning as a Tool to Predict Flow Patterns in Two-Phase Flow
In order to better model complex real-world data such as multiphase flow, one approach is to develop pattern recognition techniques and robust features that capture the relevant information. In this paper, we use deep le…