paper-with-me

Papers

HIME: Efficient Headshot Image Super-Resolution with Multiple Exemplars

2022-03-28 · Xiaoyu Xiang, Jon Morton, Fitsum A Reda, Lucas Young, Federico Perazzi, Rakesh Ranjan, Amit Kumar, Andrea Colaco, Jan Allebach

A promising direction for recovering the lost information in low-resolution headshot images is utilizing a set of high-resolution exemplars from the same identity. Complementary images in the reference set can improve the generated headshot quality across many different views and poses. However, it is challenging to make the best use of multiple exemplars: the quality and alignment of each exemplar cannot be guaranteed. Using low-quality and mismatched images as references will impair the output results. To overcome these issues, we propose an efficient Headshot Image Super-Resolution with Multiple Exemplars network (HIME) method. Compared with previous methods, our network can effectively handle the misalignment between the input and the reference without requiring facial priors and learn the aggregated reference set representation in an end-to-end manner. Furthermore, to reconstruct more detailed facial features, we propose a correlation loss that provides a rich representation of the local texture in a controllable spatial range. Experimental results demonstrate that the proposed framework not only has significantly fewer computation cost than recent exemplar-guided methods but also achieves better qualitative and quantitative performance.

📄 PDF Abstract BibTeX arXiv:2203.14863

Code (0)

등록된 구현이 없습니다.

Tasks

Image Super-ResolutionSuper-Resolution

Similar Papers 제목 키워드 기반

3DPortraitGAN: Learning One-Quarter Headshot 3D GANs from a Single-View Portrait Dataset with Diverse Body Poses

2023-07-27 · Yiqian Wu, Hao Xu, Xiangjun Tang, Hongbo Fu 외

3D-aware face generators are typically trained on 2D real-life face image datasets that primarily consist of near-frontal face data, and as such, they are unable to construct one-quarter headshot 3D portraits with comple…

Self-Learning

Stylizing Face Images via Multiple Exemplars

2017-08-28 · Yibing Song, Linchao Bao, Shengfeng He, Qingxiong Yang 외

We address the problem of transferring the style of a headshot photo to face images. Existing methods using a single exemplar lead to inaccurate results when the exemplar does not contain sufficient stylized facial compo…

The CHiME-7 DASR Challenge: Distant Meeting Transcription with Multiple Devices in Diverse Scenarios

2023-06-23 · Samuele Cornell, Matthew Wiesner, Shinji Watanabe, Desh Raj 외

The CHiME challenges have played a significant role in the development and evaluation of robust automatic speech recognition (ASR) systems. We introduce the CHiME-7 distant ASR (DASR) task, within the 7th CHiME challenge…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)channel selectionRobust Speech Recognition+2

Portrait Neural Radiance Fields from a Single Image

2020-12-10 · Chen Gao, YiChang Shih, Wei-Sheng Lai, Chia-Kai Liang 외

We present a method for estimating Neural Radiance Fields (NeRF) from a single headshot portrait. While NeRF has demonstrated high-quality view synthesis, it requires multiple images of static scenes and thus impractical…

Meta-LearningNeRF

Chimera: Designing and Chinchilla-Scaling Hybrid Visual Diffusion Transformers

2026-07-30 · Chongjian Ge, Hanwen Jiang, Tianyu Wang, Jiuxiang Gu 외 arxiv

Visual generation increasingly requires high-resolution images, long videos, and multimodal context, making the quadratic cost of full attention prohibitive. We introduce Chimera, a hybrid visual diffusion backbone with …