paper-with-me

홈 › Papers

Unsupervised Landmark Detection Based Spatiotemporal Motion Estimation for 4D Dynamic Medical Images

2021-09-30 · Yuyu Guo, Lei Bi, Dongming Wei, Liyun Chen, Zhengbin Zhu, Dagan Feng, Ruiyan Zhang, Qian Wang, Jinman Kim

Motion estimation is a fundamental step in dynamic medical image processing for the assessment of target organ anatomy and function. However, existing image-based motion estimation methods, which optimize the motion field by evaluating the local image similarity, are prone to produce implausible estimation, especially in the presence of large motion. In this study, we provide a novel motion estimation framework of Dense-Sparse-Dense (DSD), which comprises two stages. In the first stage, we process the raw dense image to extract sparse landmarks to represent the target organ anatomical topology and discard the redundant information that is unnecessary for motion estimation. For this purpose, we introduce an unsupervised 3D landmark detection network to extract spatially sparse but representative landmarks for the target organ motion estimation. In the second stage, we derive the sparse motion displacement from the extracted sparse landmarks of two images of different time points. Then, we present a motion reconstruction network to construct the motion field by projecting the sparse landmarks displacement back into the dense image domain. Furthermore, we employ the estimated motion field from our two-stage DSD framework as initialization and boost the motion estimation quality in light-weight yet effective iterative optimization. We evaluate our method on two dynamic medical imaging tasks to model cardiac motion and lung respiratory motion, respectively. Our method has produced superior motion estimation accuracy compared to existing comparative methods. Besides, the extensive experimental results demonstrate that our solution can extract well representative anatomical landmarks without any requirement of manual annotation. Our code is publicly available online.

📄 PDF Abstract BibTeX arXiv:2109.14805

Code (2)

guoyu-niubility/dsd-3d-unsupervised-landmark-detection-based-motion-estimation 공식 구현 pytorch
yyguo-sjtu/dsd-3d-unsupervised-landmark-detection-based-motion-estimation 공식 구현 pytorch

Tasks

AnatomyMotion EstimationUnsupervised Landmark Detection

Similar Papers 제목 키워드 기반

Unsupervised Discovery of Facial Landmarks and Head Pose

2025-01-01 · CVPR 2025 1 · Satyajit Tourani, Siddharth Tourani, Arif Mahmood, Muhammad Haris Khan

Unsupervised landmark and head pose estimation is fundamental in fields like biometrics, augmented reality, and emotion recognition, offering accurate spatial data without relying on labeled datasets. It enhances sca…

Emotion RecognitionHead Pose EstimationLandmark TrackingPose Estimation+1

Learning the Imaging Landmarks: Unsupervised Key point Detection in Lung Ultrasound Videos

2021-06-13 · Arpan Tripathi, Mahesh Raveendranatha Panicker, Abhilash R Hareendranathan, Yale Tung Chen 외

Lung ultrasound (LUS) is an increasingly popular diagnostic imaging modality for continuous and periodic monitoring of lung infection, given its advantages of non-invasiveness, non-ionizing nature, portability and easy d…

Diagnostic

Learning Temporally and Semantically Consistent Unpaired Video-to-video Translation Through Pseudo-Supervision From Synthetic Optical Flow

2022-01-15 · Kaihong Wang, Kumar Akash, Teruhisa Misu

Unpaired video-to-video translation aims to translate videos between a source and a target domain without the need of paired training data, making it more feasible for real applications. Unfortunately, the translated vid…

Motion EstimationOptical Flow EstimationTranslation

Enhanced detection of fetal pose in 3D MRI by Deep Reinforcement Learning with physical structure priors on anatomy

2020-07-16 · Molin Zhang, Junshen Xu, Esra Abaci Turk, P. Ellen Grant 외

Fetal MRI is heavily constrained by unpredictable and substantial fetal motion that causes image artifacts and limits the set of viable diagnostic image contrasts. Current mitigation of motion artifacts is predominantly …

AnatomyDecision MakingDeep Reinforcement LearningDiagnostic

Sequential anatomy localization in fetal echocardiography videos

2018-10-28 · Arijit Patra, J. A. Noble

Fetal heart motion is an important diagnostic indicator for structural detection and functional assessment of congenital heart disease. We propose an approach towards integrating deep convolutional and recurrent architec…

Anatomical Landmark DetectionAnatomyDiagnostic