Learning Higher-Order Dynamics in Video-Based Cardiac Measurement
Computer vision methods typically optimize for first-order dynamics (e.g., optical flow). However, in many cases the properties of interest are subtle variations in higher-order changes, such as acceleration. This is true in the cardiac pulse, where the second derivative can be used as an indicator of blood pressure and arterial disease. Recent developments in camera-based vital sign measurement have shown that cardiac measurements can be recovered with impressive accuracy from videos; however, most of the research has focused on extracting summary statistics such as heart rate. Less emphasis has been put on the accuracy of waveform morphology that is necessary for many clinically meaningful assessments. In this work, we provide evidence that higher-order dynamics are better estimated by neural models when explicitly optimized for in the loss function. Furthermore, adding second-derivative inputs also improves performance when estimating second-order dynamics. We illustrate this, by showing that incorporating the second derivative of both the input frames and the target vital sign signals into the training procedure, models are better able to estimate left ventricle ejection time (LVET) intervals.
Code (0)
등록된 구현이 없습니다.
Tasks
Optical Flow EstimationSimilar Papers 제목 키워드 기반
A Novel Data-Driven Method for the Analysis and Reconstruction of Cardiac Cine MRI
Cardiac cine magnetic resonance imaging (MRI) can be considered the optimal criterion for measuring cardiac function. This imaging technique can provide us with detailed information about cardiac structure, tissue compos…
DeU-Net: Deformable U-Net for 3D Cardiac MRI Video Segmentation
Automatic segmentation of cardiac magnetic resonance imaging (MRI) facilitates efficient and accurate volume measurement in clinical applications. However, due to anisotropic resolution and ambiguous border (e.g., right …
Video SegmentationVideo Semantic SegmentationHigher Order Dynamic Mode Decomposition: from Fluid Dynamics to Heart Disease Analysis
In this work, we study in detail the performance of Higher Order Dynamic Mode Decomposition (HODMD) technique when applied to echocardiography images. HODMD is a data-driven method generally used in fluid dynamics and in…
Fully Unsupervised Dynamic MRI Reconstruction via Diffeo-Temporal Equivariance
Reconstructing dynamic MRI image sequences from undersampled accelerated measurements is crucial for faster and higher spatiotemporal resolution real-time imaging of cardiac motion, free breathing motion and many other a…
MRI ReconstructionLearning Disease-Sensitive Latent Interaction Graphs From Noisy Cardiac Flow Measurements
Cardiac blood flow patterns contain rich information about disease severity and clinical interventions, yet current imaging and computational methods fail to capture underlying relational structures of coherent flow feat…