Structure-Aware Long Short-Term Memory Network for 3D Cephalometric Landmark Detection
Detecting 3D landmarks on cone-beam computed tomography (CBCT) is crucial to assessing and quantifying the anatomical abnormalities in 3D cephalometric analysis. However, the current methods are time-consuming and suffer from large biases in landmark localization, leading to unreliable diagnosis results. In this work, we propose a novel Structure-Aware Long Short-Term Memory framework (SA-LSTM) for efficient and accurate 3D landmark detection. To reduce the computational burden, SA-LSTM is designed in two stages. It first locates the coarse landmarks via heatmap regression on a down-sampled CBCT volume and then progressively refines landmarks by attentive offset regression using multi-resolution cropped patches. To boost accuracy, SA-LSTM captures global-local dependence among the cropping patches via self-attention. Specifically, a novel graph attention module implicitly encodes the landmark's global structure to rationalize the predicted position. Moreover, a novel attention-gated module recursively filters irrelevant local features and maintains high-confident local predictions for aggregating the final result. Experiments conducted on an in-house dataset and a public dataset show that our method outperforms state-of-the-art methods, achieving 1.64 mm and 2.37 mm average errors, respectively. Furthermore, our method is very efficient, taking only 0.5 seconds for inferring the whole CBCT volume of resolution 768$\times$768$\times$576.
Code (1)
Tasks
Graph AttentionregressionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Preference-Aware Memory Update for Long-Term LLM Agents
One of the key factors influencing the reasoning capabilities of LLM-based agents is their ability to leverage long-term memory. Integrating long-term memory mechanisms allows agents to make informed decisions grounded i…
Knowledge GraphsSequential Recommender via Time-aware Attentive Memory Network
Recommendation systems aim to assist users to discover most preferred contents from an ever-growing corpus of items. Although recommenders have been greatly improved by deep learning, they still faces several challenges:…
Recommendation SystemsRetrievalAdaptive User Modeling with Long and Short-Term Preferences for Personalized Recommendation
User modeling is an essential task for online rec- ommender systems. In the past few decades, col- laborative filtering (CF) techniques have been well studied to model users’ long term preferences. Recently, recurrent ne…
Language ModelingLanguage ModellingRecommendation SystemsSequential RecommendationTree Memory Networks for Modelling Long-term Temporal Dependencies
In the domain of sequence modelling, Recurrent Neural Networks (RNN) have been capable of achieving impressive results in a variety of application areas including visual question answering, part-of-speech tagging and mac…
Machine TranslationPart-Of-Speech TaggingQuestion AnsweringTrajectory Prediction+2Concurrence-Aware Long Short-Term Sub-Memories for Person-Person Action Recognition
Recently, Long Short-Term Memory (LSTM) has become a popular choice to model individual dynamics for single-person action recognition due to its ability of modeling the temporal information in various ranges of dynamic c…
Action RecognitionTemporal Action Localization