Landmark Detection using Transformer Toward Robot-assisted Nasal Airway Intubation
Robot-assisted airway intubation application needs high accuracy in locating targets and organs. Two vital landmarks, nostrils and glottis, can be detected during the intubation to accommodate the stages of nasal intubation. Automated landmark detection can provide accurate localization and quantitative evaluation. The Detection Transformer (DeTR) leads object detectors to a new paradigm with long-range dependence. However, current DeTR requires long iterations to converge, and does not perform well in detecting small objects. This paper proposes a transformer-based landmark detection solution with deformable DeTR and the semantic-aligned-matching module for detecting landmarks in robot-assisted intubation. The semantics aligner can effectively align the semantics of object queries and image features in the same embedding space using the most discriminative features. To evaluate the performance of our solution, we utilize a publicly accessible glottis dataset and automatically annotate a nostril detection dataset. The experimental results demonstrate our competitive performance in detection accuracy. Our code is publicly accessible.
Code (1)
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Nasal Patches and Curves for Expression-robust 3D Face Recognition
The potential of the nasal region for expression robust 3D face recognition is thoroughly investigated by a novel five-step algorithm. First, the nose tip location is coarsely detected and the face is segmented, aligned …
DenoisingFace RecognitionA Fully Automated System for Sizing Nasal PAP Masks Using Facial Photographs
We present a fully automated system for sizing nasal Positive Airway Pressure (PAP) masks. The system is comprised of a mix of HOG object detectors as well as multiple convolutional neural network stages for facial landm…
Facial Landmark DetectionTransfer LearningAutomatic Tool Landmark Detection for Stereo Vision in Robot-Assisted Retinal Surgery
Computer vision and robotics are being increasingly applied in medical interventions. Especially in interventions where extreme precision is required they could make a difference. One such application is robot-assisted r…
3D ReconstructionAnatomyLAKAN: Landmark-assisted Adaptive Kolmogorov-Arnold Network for Face Forgery Detection
The rapid development of deepfake generation techniques necessitates robust face forgery detection algorithms. While methods based on Convolutional Neural Networks (CNNs) and Transformers are effective, there is still ro…
DATR: Domain-adaptive transformer for multi-domain landmark detection
Accurate anatomical landmark detection plays an increasingly vital role in medical image analysis. Although existing methods achieve satisfying performance, they are mostly based on CNN and specialized for a single domai…
Anatomical Landmark DetectionAnatomyMedical Image Analysis