paper-with-me

홈 › Papers

AesFA: An Aesthetic Feature-Aware Arbitrary Neural Style Transfer

2023-12-10 · Joonwoo Kwon, Sooyoung Kim, Yuewei Lin, Shinjae Yoo, Jiook Cha

Neural style transfer (NST) has evolved significantly in recent years. Yet, despite its rapid progress and advancement, existing NST methods either struggle to transfer aesthetic information from a style effectively or suffer from high computational costs and inefficiencies in feature disentanglement due to using pre-trained models. This work proposes a lightweight but effective model, AesFA -- Aesthetic Feature-Aware NST. The primary idea is to decompose the image via its frequencies to better disentangle aesthetic styles from the reference image while training the entire model in an end-to-end manner to exclude pre-trained models at inference completely. To improve the network's ability to extract more distinct representations and further enhance the stylization quality, this work introduces a new aesthetic feature: contrastive loss. Extensive experiments and ablations show the approach not only outperforms recent NST methods in terms of stylization quality, but it also achieves faster inference. Codes are available at https://github.com/Sooyyoungg/AesFA.

📄 PDF Abstract BibTeX arXiv:2312.05928

Code (1)

sooyyoungg/aesfa 공식 구현 pytorch

Tasks

DisentanglementStyle Transfer

Similar Papers 제목 키워드 기반

AesUST: Towards Aesthetic-Enhanced Universal Style Transfer

2022-08-27 · Zhizhong Wang, Zhanjie Zhang, Lei Zhao, Zhiwen Zuo 외

Recent studies have shown remarkable success in universal style transfer which transfers arbitrary visual styles to content images. However, existing approaches suffer from the aesthetic-unrealistic problem that introduc…

Style Transfer

AesPA-Net: Aesthetic Pattern-Aware Style Transfer Networks

2023-07-19 · ICCV 2023 1 · Kibeom Hong, Seogkyu Jeon, Junsoo Lee, Namhyuk Ahn 외

To deliver the artistic expression of the target style, recent studies exploit the attention mechanism owing to its ability to map the local patches of the style image to the corresponding patches of the content image. H…

RhythmSemantic correspondenceStyle Transfer

Disentangling Structure and Aesthetics for Style-Aware Image Completion

2018-06-01 · CVPR 2018 6 · Andrew Gilbert, John Collomosse, Hailin Jin, Brian Price

Content-aware image completion or in-painting is a fundamental tool for the correction of defects or removal of objects in images. We propose a non-parametric in-painting algorithm that enforces both structural and aest…

A-Lamp: Adaptive Layout-Aware Multi-Patch Deep Convolutional Neural Network for Photo Aesthetic Assessment

2017-04-02 · CVPR 2017 7 · Shuang Ma, Jing Liu, Chang Wen Chen

Deep convolutional neural networks (CNN) have recently been shown to generate promising results for aesthetics assessment. However, the performance of these deep CNN methods is often compromised by the constraint that th…

Aesthetics Quality Assessment

Retinex-guided Channel-grouping based Patch Swap for Arbitrary Style Transfer

2023-09-19 · Chang Liu, Yi Niu, Mingming Ma, Fu Li 외

The basic principle of the patch-matching based style transfer is to substitute the patches of the content image feature maps by the closest patches from the style image feature maps. Since the finite features harvested …

Patch MatchingStyle Transfer