Joint Large-Scale Motion Estimation and Image Reconstruction
This article describes the implementation of the joint motion estimation and image reconstruction framework presented by Burger, Dirks and Sch\"onlieb and extends this framework to large-scale motion between consecutive image frames. The variational framework uses displacements between consecutive frames based on the optical flow approach to improve the image reconstruction quality on the one hand and the motion estimation quality on the other. The energy functional consists of a data-fidelity term with a general operator that connects the input sequence to the solution, it has a total variation term for the image sequence and is connected to the underlying flow using an optical flow term. Additional spatial regularity for the flow is modeled by a total variation regularizer for both components of the flow. The numerical minimization is performed in an alternating manner using primal-dual techniques. The resulting schemes are presented as pseudo-code together with a short numerical evaluation.
Code (0)
등록된 구현이 없습니다.
Tasks
Image ReconstructionMotion EstimationOptical Flow EstimationSimilar Papers 제목 키워드 기반
Joint Learning of Motion Estimation and Segmentation for Cardiac MR Image Sequences
Cardiac motion estimation and segmentation play important roles in quantitatively assessing cardiac function and diagnosing cardiovascular diseases. In this paper, we propose a novel deep learning method for joint estima…
Cardiac SegmentationMotion EstimationSegmentationWeakly supervised segmentationPoint2Pose: A Generative Framework for 3D Human Pose Estimation with Multi-View Point Cloud Dataset
We propose a novel generative approach for 3D human pose estimation. 3D human pose estimation poses several key challenges due to the complex geometry of the human body, self-occluding joints, and the requirement for lar…
3D Human Pose EstimationPoint CloudsConfidence-aware Levenberg-Marquardt optimization for joint motion estimation and super-resolution
Motion estimation across low-resolution frames and the reconstruction of high-resolution images are two coupled subproblems of multi-frame super-resolution. This paper introduces a new joint optimization approach for mot…
Image ReconstructionMotion EstimationMulti-Frame Super-ResolutionSuper-ResolutionSimPoE: Simulated Character Control for 3D Human Pose Estimation
Accurate estimation of 3D human motion from monocular video requires modeling both kinematics (body motion without physical forces) and dynamics (motion with physical forces). To demonstrate this, we present SimPoE, a Si…
3D Human Pose EstimationPose EstimationDirection-Aware Hybrid Representation Learning for 3D Hand Pose and Shape Estimation
Most model-based 3D hand pose and shape estimation methods directly regress the parametric model parameters from an image to obtain 3D joints under weak supervision. However, these methods involve solving a complex optim…
Contrastive LearningRepresentation Learning