Multi-frame Feature Aggregation for Real-time Instrument Segmentation in Endoscopic Video

2020-11-17 · Shan Lin, Fangbo Qin, Haonan Peng, Randall A. Bly, Kris S. Moe, Blake Hannaford

Deep learning-based methods have achieved promising results on surgical instrument segmentation. However, the high computation cost may limit the application of deep models to time-sensitive tasks such as online surgical video analysis for robotic-assisted surgery. Moreover, current methods may still suffer from challenging conditions in surgical images such as various lighting conditions and the presence of blood. We propose a novel Multi-frame Feature Aggregation (MFFA) module to aggregate video frame features temporally and spatially in a recurrent mode. By distributing the computation load of deep feature extraction over sequential frames, we can use a lightweight encoder to reduce the computation costs at each time step. Moreover, public surgical videos usually are not labeled frame by frame, so we develop a method that can randomly synthesize a surgical frame sequence from a single labeled frame to assist network training. We demonstrate that our approach achieves superior performance to corresponding deeper segmentation models on two public surgery datasets.

📄 PDF Abstract BibTeX arXiv:2011.08752

Code (0)

등록된 구현이 없습니다.

Tasks

Segmentation

Real-Time Semantic Segmentation via Auto Depth, Downsampling Joint Decision and Feature Aggregation

2020-03-31 · Peng Sun, Jiaxiang Wu, Songyuan Li, Peiwen Lin 외

To satisfy the stringent requirements on computational resources in the field of real-time semantic segmentation, most approaches focus on the hand-crafted design of light-weight segmentation networks. Recently, Neural A…

GPU Neural Architecture Search Real-Time Semantic Segmentation Segmentation+1

Improving Network Anomaly Detection via Choquet-Integral-Based Feature Aggregation

2026-07-16 · Abreu Quevedo, Roger Immich, Giancarlo Lucca, Graçaliz Dimuro 외 arxiv

This work investigates a generalized Choquet-integral-based feature aggregation framework to improve anomaly detection in high-dimensional network traffic data. The approach combines adaptive weighting with incremental f…

Intrusion Detection Anomaly Detection

Deep Multi-Branch Aggregation Network for Real-Time Semantic Segmentation in Street Scenes

2022-03-08 · Xi Weng, Yan Yan, Genshun Dong, Chang Shu 외

Real-time semantic segmentation, which aims to achieve high segmentation accuracy at real-time inference speed, has received substantial attention over the past few years. However, many state-of-the-art real-time semanti…

Decoder GPU Real-Time Semantic Segmentation Segmentation+1

CMSA-Net: Causal Multi-scale Aggregation with Adaptive Multi-source Reference for Video Polyp Segmentation

2026-02-26 · Tong Wang, Yaolei Qi, Siwen Wang, Imran Razzak 외 arxiv

Video polyp segmentation (VPS) is an important task in computer-aided colonoscopy, as it helps doctors accurately locate and track polyps during examinations. However, VPS remains challenging because polyps often look si…

Video Polyp Segmentation

Towards High-Resolution 3D Anomaly Detection: A Scalable Dataset and Real-Time Framework for Subtle Industrial Defects

2025-07-10 · Yuqi Cheng, Yihan Sun, HUI ZHANG, Weiming Shen 외

In industrial point cloud analysis, detecting subtle anomalies demands high-resolution spatial data, yet prevailing benchmarks emphasize low-resolution inputs. To address this disparity, we propose a scalable pipeline fo…

3D Anomaly Detection Anomaly Detection