OperA: Attention-Regularized Transformers for Surgical Phase Recognition
In this paper we introduce OperA, a transformer-based model that accurately predicts surgical phases from long video sequences. A novel attention regularization loss encourages the model to focus on high-quality frames during training. Moreover, the attention weights are utilized to identify characteristic high attention frames for each surgical phase, which could further be used for surgery summarization. OperA is thoroughly evaluated on two datasets of laparoscopic cholecystectomy videos, outperforming various state-of-the-art temporal refinement approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Surgical phase recognitionSimilar Papers 제목 키워드 기반
Friends Across Time: Multi-Scale Action Segmentation Transformer for Surgical Phase Recognition
Automatic surgical phase recognition is a core technology for modern operating rooms and online surgical video assessment platforms. Current state-of-the-art methods use both spatial and temporal information to tackle th…
Action SegmentationOffline surgical phase recognitionOnline surgical phase recognitionSegmentation+1MuST: Multi-Scale Transformers for Surgical Phase Recognition
Phase recognition in surgical videos is crucial for enhancing computer-aided surgical systems as it enables automated understanding of sequential procedural stages. Existing methods often rely on fixed temporal windows f…
Online surgical phase recognitionSurgical phase recognitionEgoSurgery-Phase: A Dataset of Surgical Phase Recognition from Egocentric Open Surgery Videos
Surgical phase recognition has gained significant attention due to its potential to offer solutions to numerous demands of the modern operating room. However, most existing methods concentrate on minimally invasive surge…
Action RecognitionSurgical phase recognitionVideo UnderstandingTUNeS: A Temporal U-Net with Self-Attention for Video-based Surgical Phase Recognition
Objective: To enable context-aware computer assistance in the operating room of the future, cognitive systems need to understand automatically which surgical phase is being performed by the medical team. The primary sour…
Surgical phase recognitionBenchmarking and Enhancing Surgical Phase Recognition Models for Robotic-Assisted Esophagectomy
Robotic-assisted minimally invasive esophagectomy (RAMIE) is a recognized treatment for esophageal cancer, offering better patient outcomes compared to open surgery and traditional minimally invasive surgery. RAMIE is hi…
BenchmarkingDecoderDeep LearningSurgical phase recognition