Towards Head Motion Compensation Using Multi-Scale Convolutional Neural Networks
Head pose estimation and tracking is useful in variety of medical applications. With the advent of RGBD cameras like Kinect, it has become feasible to do markerless tracking by estimating the head pose directly from the point clouds. One specific medical application is robot assisted transcranial magnetic stimulation (TMS) where any patient motion is compensated with the help of a robot. For increased patient comfort, it is important to track the head without markers. In this regard, we address the head pose estimation problem using two different approaches. In the first approach, we build upon the more traditional approach of model based head tracking, where a head model is morphed according to the particular head to be tracked and the morphed model is used to track the head in the point cloud streams. In the second approach, we propose a new multi-scale convolutional neural network architecture for more accurate pose regression. Additionally, we outline a systematic data set acquisition strategy using a head phantom mounted on the robot and ground-truth labels generated using a highly accurate tracking system.
Code (0)
등록된 구현이 없습니다.
Tasks
Head Pose EstimationMotion CompensationPose EstimationSimilar Papers 제목 키워드 기반
Synergizing Motion and Appearance: Multi-Scale Compensatory Codebooks for Talking Head Video Generation
Talking head video generation aims to generate a realistic talking head video that preserves the person's identity from a source image and the motion from a driving video. Despite the promising progress made in the field…
Video GenerationRetrospective Motion Correction in Gradient Echo MRI by Explicit Motion Estimation Using Deep CNNs
Magnetic Resonance Imaging allows high resolution data acquisition with the downside of motion sensitivity due to relatively long acquisition times. Even during the acquisition of a single 2D slice, motion can severely c…
compressed sensingMotion CompensationMotion EstimationSensitivityReal-Time Video Deblurring via Lightweight Motion Compensation
While motion compensation greatly improves video deblurring quality, separately performing motion compensation and video deblurring demands huge computational overhead. This paper proposes a real-time video deblurring fr…
DeblurringMotion CompensationVideo DeblurringLVC-LGMC: Joint Local and Global Motion Compensation for Learned Video Compression
Existing learned video compression models employ flow net or deformable convolutional networks (DCN) to estimate motion information. However, the limited receptive fields of flow net and DCN inherently direct their atten…
Motion CompensationVideo CompressionU-Motion: Learned Point Cloud Video Compression with U-Structured Temporal Context Generation
Point cloud video (PCV) is a versatile 3D representation of dynamic scenes with emerging applications. This paper introduces U-Motion, a learning-based compression scheme for both PCV geometry and attributes. We propose …
AttributeMotion CompensationMotion EstimationVideo Compression