paper-with-me

홈 › Papers

Practical Wide-Angle Portraits Correction with Deep Structured Models

2021-04-26 · CVPR 2021 1 · Jing Tan, Shan Zhao, Pengfei Xiong, Jiangyu Liu, Haoqiang Fan, Shuaicheng Liu

Wide-angle portraits often enjoy expanded views. However, they contain perspective distortions, especially noticeable when capturing group portrait photos, where the background is skewed and faces are stretched. This paper introduces the first deep learning based approach to remove such artifacts from freely-shot photos. Specifically, given a wide-angle portrait as input, we build a cascaded network consisting of a LineNet, a ShapeNet, and a transition module (TM), which corrects perspective distortions on the background, adapts to the stereographic projection on facial regions, and achieves smooth transitions between these two projections, accordingly. To train our network, we build the first perspective portrait dataset with a large diversity in identities, scenes and camera modules. For the quantitative evaluation, we introduce two novel metrics, line consistency and face congruence. Compared to the previous state-of-the-art approach, our method does not require camera distortion parameters. We demonstrate that our approach significantly outperforms the previous state-of-the-art approach both qualitatively and quantitatively.

📄 PDF Abstract BibTeX arXiv:2104.12464

Code (1)

TanJing94/Deep_Portraits_Correction 공식 구현 pytorch

Tasks

Diversity

Similar Papers 제목 키워드 기반

Semi-Supervised Wide-Angle Portraits Correction by Multi-Scale Transformer

2021-09-14 · CVPR 2022 1 · Fushun Zhu, Shan Zhao, Peng Wang, Hao Wang 외

We propose a semi-supervised network for wide-angle portraits correction. Wide-angle images often suffer from skew and distortion affected by perspective distortion, especially noticeable at the face regions. Previous de…

GMTalker: Gaussian Mixture-based Audio-Driven Emotional Talking Video Portraits

2023-12-12 · Yibo Xia, Lizhen Wang, Xiang Deng, Xiaoyan Luo 외

Synthesizing high-fidelity and emotion-controllable talking video portraits, with audio-lip sync, vivid expressions, realistic head poses, and eye blinks, has been an important and challenging task in recent years. Most …

Diversity

Audio-Driven Emotional Video Portraits

2021-04-15 · CVPR 2021 1 · Xinya Ji, Hang Zhou, Kaisiyuan Wang, Wayne Wu 외

Despite previous success in generating audio-driven talking heads, most of the previous studies focus on the correlation between speech content and the mouth shape. Facial emotion, which is one of the most important feat…

DisentanglementFace Generation

3DPortraitGAN: Learning One-Quarter Headshot 3D GANs from a Single-View Portrait Dataset with Diverse Body Poses

2023-07-27 · Yiqian Wu, Hao Xu, Xiangjun Tang, Hongbo Fu 외

3D-aware face generators are typically trained on 2D real-life face image datasets that primarily consist of near-frontal face data, and as such, they are unable to construct one-quarter headshot 3D portraits with comple…

Self-Learning

Modeling Photographic Composition via Triangles

2016-05-31 · Zihan Zhou, Siqiong He, Jia Li, James Z. Wang

The capacity of automatically modeling photographic composition is valuable for many real-world machine vision applications such as digital photography, image retrieval, image understanding, and image aesthetics assessme…

Image RetrievalRetrieval