paper-with-me

홈 › Papers

Efficient Hybrid Zoom using Camera Fusion on Mobile Phones

2024-01-02 · Xiaotong Wu, Wei-Sheng Lai, YiChang Shih, Charles Herrmann, Michael Krainin, Deqing Sun, Chia-Kai Liang

DSLR cameras can achieve multiple zoom levels via shifting lens distances or swapping lens types. However, these techniques are not possible on smartphone devices due to space constraints. Most smartphone manufacturers adopt a hybrid zoom system: commonly a Wide (W) camera at a low zoom level and a Telephoto (T) camera at a high zoom level. To simulate zoom levels between W and T, these systems crop and digitally upsample images from W, leading to significant detail loss. In this paper, we propose an efficient system for hybrid zoom super-resolution on mobile devices, which captures a synchronous pair of W and T shots and leverages machine learning models to align and transfer details from T to W. We further develop an adaptive blending method that accounts for depth-of-field mismatches, scene occlusion, flow uncertainty, and alignment errors. To minimize the domain gap, we design a dual-phone camera rig to capture real-world inputs and ground-truths for supervised training. Our method generates a 12-megapixel image in 500ms on a mobile platform and compares favorably against state-of-the-art methods under extensive evaluation on real-world scenarios.

📄 PDF Abstract BibTeX arXiv:2401.01461

Code (0)

등록된 구현이 없습니다.

Tasks

Super-Resolution

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Dual-Camera Smooth Zoom on Mobile Phones

2024-04-07 · Renlong Wu, Zhilu Zhang, Yu Yang, WangMeng Zuo

When zooming between dual cameras on a mobile, noticeable jumps in geometric content and image color occur in the preview, inevitably affecting the user's zoom experience. In this work, we introduce a new task, ie, dual-…

Joint HDR Denoising and Fusion: A Real-World Mobile HDR Image Dataset

2023-01-01 · CVPR 2023 1 · Shuaizheng Liu, Xindong Zhang, Lingchen Sun, Zhetong Liang 외

Mobile phones have become a ubiquitous and indispensable photographing device in our daily life, while the small aperture and sensor size make mobile phones more susceptible to noise and over-saturation, resulting in…

Denoising

Face Deblurring using Dual Camera Fusion on Mobile Phones

2022-07-23 · Wei-Sheng Lai, YiChang Shih, Lun-Cheng Chu, Xiaotong Wu 외

Motion blur of fast-moving subjects is a longstanding problem in photography and very common on mobile phones due to limited light collection efficiency, particularly in low-light conditions. While we have witnessed grea…

DeblurringImage DeblurringVideo Deblurring

CineMobile: On-Device Image-to-Video Diffusion for Cinematic Camera Motion Generation

2026-07-04 · Xuyao Huang, Zelai Deng, Xu Wang, Xizhong Xiao 외 hf

The growing demand for image-to-video creation on mobile devices has increasingly focused on cinematic motion effects like bullet time, dolly zoom, slow motion, etc. While Diffusion Transformers (DiTs) exhibit strong per…

Reinforcement LearningVideo Generation

Handheld Multi-Frame Super-Resolution

2019-05-08 · Bartlomiej Wronski, Ignacio Garcia-Dorado, Manfred Ernst, Damien Kelly 외

Compared to DSLR cameras, smartphone cameras have smaller sensors, which limits their spatial resolution; smaller apertures, which limits their light gathering ability; and smaller pixels, which reduces their signal-to n…

DemosaickingMulti-Frame Super-ResolutionSuper-Resolution