Selfie Video Stabilization
We propose a novel algorithm for stabilizing selfie videos. Our goal is to automatically generate stabilized video that has optimal smooth motion in the sense of both foreground and background. The key insight is that non-rigid foreground motion in selfie videos can be analyzed using a 3D face model, and background motion can be analyzed using optical flow. We use second derivative of temporal trajectory of selected pixels as the measure of smoothness. Our algorithm stabilizes selfie videos by minimizing the smoothness measure of the back-ground, regularized by the motion of the foreground. Experiments show that our method outperforms state-of-the-art general video stabilization techniques in selfie videos.
Code (0)
등록된 구현이 없습니다.
Tasks
Face ModelOptical Flow EstimationVideo StabilizationSimilar Papers 제목 키워드 기반
Real-Time Selfie Video Stabilization
We propose a novel real-time selfie video stabilization method. Our method is completely automatic and runs at 26 fps. We use a 1D linear convolutional network to directly infer the rigid moving least squares warping whi…
Video StabilizationHybrid Neural Fusion for Full-frame Video Stabilization
Existing video stabilization methods often generate visible distortion or require aggressive cropping of frame boundaries, resulting in smaller field of views. In this work, we present a frame synthesis algorithm to achi…
Optical Flow EstimationVideo StabilizationSteadiface: Real-Time Face-Centric Stabilization on Mobile Phones
We present Steadiface, a new real-time face-centric video stabilization method that simultaneously removes hand shake and keeps subject's head stable. We use a CNN to estimate the face landmarks and use them to optimize …
TranslationVideo StabilizationTranStable: Towards Robust Pixel-level Online Video Stabilization by Jointing Transformer and CNN
Video stabilization often struggles with distortion and excessive cropping. This paper proposes a novel end-to-end framework, named TranStable, to address these challenges, comprising a genera tor and a discriminator. We…
Video StabilizationVideo to Fully Automatic 3D Hair Model
Imagine taking a selfie video with your mobile phone and getting as output a 3D model of your head (face and 3D hair strands) that can be later used in VR, AR, and any other domain. State of the art hair reconstruction m…
model