paper-with-me

홈 › Papers

Test-time Cost-and-Quality Controllable Arbitrary-Scale Super-Resolution with Variable Fourier Components

2024-12-07 · Kazutoshi Akita, Norimichi Ukita

Super-resolution (SR) with arbitrary scale factor and cost-and-quality controllability at test time is essential for various applications. While several arbitrary-scale SR methods have been proposed, these methods require us to modify the model structure and retrain it to control the computational cost and SR quality. To address this limitation, we propose a novel SR method using a Recurrent Neural Network (RNN) with the Fourier representation. In our method, the RNN sequentially estimates Fourier components, each consisting of frequency and amplitude, and aggregates these components to reconstruct an SR image. Since the RNN can adjust the number of recurrences at test time, we can control the computational cost and SR quality in a single model: fewer recurrences (i.e., fewer Fourier components) lead to lower cost but lower quality, while more recurrences (i.e., more Fourier components) lead to better quality but more cost. Experimental results prove that more Fourier components improve the PSNR score. Furthermore, even with fewer Fourier components, our method achieves a lower PSNR drop than other state-of-the-art arbitrary-scale SR methods.

📄 PDF Abstract BibTeX arXiv:2412.05517

Code (0)

등록된 구현이 없습니다.

Tasks

Super-Resolution

Similar Papers 제목 키워드 기반

Efficient Cost-and-Quality Controllable Arbitrary-scale Super-resolution with Fourier Constraints

2025-10-28 · Kazutoshi Akita, Norimichi Ukita arxiv

Cost-and-Quality (CQ) controllability in arbitrary-scale super-resolution is crucial. Existing methods predict Fourier components one by one using a recurrent neural network. However, this approach leads to performance d…

OPT: One-shot Pose-Controllable Talking Head Generation

2023-02-16 · Jin Liu, Xi Wang, Xiaomeng Fu, Yesheng Chai 외

One-shot talking head generation produces lip-sync talking heads based on arbitrary audio and one source face. To guarantee the naturalness and realness, recent methods propose to achieve free pose control instead of sim…

DisentanglementTalking Head Generation

PIXLRelight: Controllable Relighting via Intrinsic Conditioning

2026-05-18 · Miguel Farinha, Ronald Clark arxiv

We present PIXLRelight, a feed-forward approach for physically controllable single-image relighting. Existing methods either provide limited lighting control (e.g. through text or environment maps), accumulate errors whe…

3D ReconstructionImage Relighting

Controlled Language and Baby Turing Test for General Conversational Intelligence

2020-05-19 · Anton Kolonin

General conversational intelligence appears to be an important part of artificial general intelligence. Respectively, it requires accessible measures of the intelligence quality and controllable ways of its achievement, …

CA-GAN: Weakly Supervised Color Aware GAN for Controllable Makeup Transfer

2020-08-24 · Robin Kips, Pietro Gori, Matthieu Perrot, Isabelle Bloch

While existing makeup style transfer models perform an image synthesis whose results cannot be explicitly controlled, the ability to modify makeup color continuously is a desirable property for virtual try-on application…

AttributeImage GenerationStyle TransferVirtual Try-on+1