paper-with-me

홈 › Papers

SurgT challenge: Benchmark of Soft-Tissue Trackers for Robotic Surgery

2023-02-06 · Joao Cartucho, Alistair Weld, Samyakh Tukra, Haozheng Xu, Hiroki Matsuzaki, Taiyo Ishikawa, Minjun Kwon, Yong Eun Jang, Kwang-Ju Kim, Gwang Lee, Bizhe Bai, Lueder Kahrs, Lars Boecking, Simeon Allmendinger, Leopold Muller, Yitong Zhang, Yueming Jin, Sophia Bano, Francisco Vasconcelos, Wolfgang Reiter, Jonas Hajek, Bruno Silva, Estevao Lima, Joao L. Vilaca, Sandro Queiros, Stamatia Giannarou

This paper introduces the ``SurgT: Surgical Tracking" challenge which was organised in conjunction with MICCAI 2022. There were two purposes for the creation of this challenge: (1) the establishment of the first standardised benchmark for the research community to assess soft-tissue trackers; and (2) to encourage the development of unsupervised deep learning methods, given the lack of annotated data in surgery. A dataset of 157 stereo endoscopic videos from 20 clinical cases, along with stereo camera calibration parameters, have been provided. Participants were assigned the task of developing algorithms to track the movement of soft tissues, represented by bounding boxes, in stereo endoscopic videos. At the end of the challenge, the developed methods were assessed on a previously hidden test subset. This assessment uses benchmarking metrics that were purposely developed for this challenge, to verify the efficacy of unsupervised deep learning algorithms in tracking soft-tissue. The metric used for ranking the methods was the Expected Average Overlap (EAO) score, which measures the average overlap between a tracker's and the ground truth bounding boxes. Coming first in the challenge was the deep learning submission by ICVS-2Ai with a superior EAO score of 0.617. This method employs ARFlow to estimate unsupervised dense optical flow from cropped images, using photometric and regularization losses. Second, Jmees with an EAO of 0.583, uses deep learning for surgical tool segmentation on top of a non-deep learning baseline method: CSRT. CSRT by itself scores a similar EAO of 0.563. The results from this challenge show that currently, non-deep learning methods are still competitive. The dataset and benchmarking tool created for this challenge have been made publicly available at https://surgt.grand-challenge.org/.

📄 PDF Abstract BibTeX arXiv:2302.03022

Code (1)

cartucho/surgt_benchmarking 공식 구현

Tasks

BenchmarkingCamera CalibrationDeep LearningOptical Flow Estimation

Methods 이 논문이 사용한 방법론

Test 설명 없음

Similar Papers 제목 키워드 기반

You Are Your Best Teacher: Semi-Supervised Surgical Point Tracking with Cycle-Consistent Self-Distillation

2025-05-09 · Valay Bundele, Mehran Hosseinzadeh, Hendrik Lensch

Synthetic datasets have enabled significant progress in point tracking by providing large-scale, densely annotated supervision. However, deploying these models in real-world domains remains challenging due to domain shif…

Point Tracking

Ada-Tracker: Soft Tissue Tracking via Inter-Frame and Adaptive-Template Matching

2024-03-11 · Jiaxin Guo, Jiangliu Wang, Zhaoshuo Li, Tongyu Jia 외

Soft tissue tracking is crucial for computer-assisted interventions. Existing approaches mainly rely on extracting discriminative features from the template and videos to recover corresponding matches. However, it is dif…

Optical Flow EstimationTemplate Matching

Beyond Instrument Motion: Recognizing Tissue Tension Toward Surgical Skill Assessment

2026-08-18 · Marko Haralovi, Zhiqi Miao, Alexander Machiel Bont, Jiapan Guo 외 arxiv

Surgical performance assessment in minimally invasive surgery largely relies on manual expert review, making it time-consuming, subjective, and difficult to scale. While existing surgical video understanding methods addr…

Surgical phase recognitionAction Recognition

SurgTrack: CAD-Free 3D Tracking of Real-world Surgical Instruments

2024-09-04 · Wenwu Guo, Jinlin Wu, Zhen Chen, Qingxiang Zhao 외

Vision-based surgical navigation has received increasing attention due to its non-invasive, cost-effective, and flexible advantages. In particular, a critical element of the vision-based navigation system is tracking sur…

SurgTEMP: Temporal-Aware Surgical Video Question Answering with Text-guided Visual Memory for Laparoscopic Cholecystectomy

2026-03-31 · Shi Li, Vinkle Srivastav, Nicolas Chanel, Saurav Sharma 외 arxiv

Surgical procedures are inherently complex and risky, requiring extensive expertise and constant focus to navigate evolving intraoperative scenes. Computer-assisted systems such as surgical visual question answering (VQA…

Visual Question AnsweringVideo Question Answering