paper-with-me

홈 › Papers

S2WAT: Image Style Transfer via Hierarchical Vision Transformer using Strips Window Attention

2022-10-22 · Chiyu Zhang, Xiaogang Xu, Lei Wang, Zaiyan Dai, Jun Yang

Transformer's recent integration into style transfer leverages its proficiency in establishing long-range dependencies, albeit at the expense of attenuated local modeling. This paper introduces Strips Window Attention Transformer (S2WAT), a novel hierarchical vision transformer designed for style transfer. S2WAT employs attention computation in diverse window shapes to capture both short- and long-range dependencies. The merged dependencies utilize the "Attn Merge" strategy, which adaptively determines spatial weights based on their relevance to the target. Extensive experiments on representative datasets show the proposed method's effectiveness compared to state-of-the-art (SOTA) transformer-based and other approaches. The code and pre-trained models are available at https://github.com/AlienZhang1996/S2WAT.

📄 PDF Abstract BibTeX arXiv:2210.12381

Code (1)

alienzhang1996/s2wat 공식 구현 pytorch

Tasks

Style Transfer

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

Similar Papers 제목 키워드 기반

StylePrompter: All Styles Need Is Attention

2023-07-30 · Chenyi Zhuang, Pan Gao, Aljosa Smolic

GAN inversion aims at inverting given images into corresponding latent codes for Generative Adversarial Networks (GANs), especially StyleGAN where exists a disentangled latent space that allows attribute-based image mani…

AllAttributeImage Manipulation

StyTr2: Image Style Transfer With Transformers

2022-01-01 · CVPR 2022 1 · Yingying Deng, Fan Tang, WeiMing Dong, Chongyang Ma 외

The goal of image style transfer is to render an image with artistic features guided by a style reference while maintaining the original content. Owing to the locality in convolutional neural networks (CNNs), extract…

DecoderStyle Transfer

StyTr$^2$: Image Style Transfer with Transformers

2021-05-30 · Yingying Deng, Fan Tang, WeiMing Dong, Chongyang Ma 외

The goal of image style transfer is to render an image with artistic features guided by a style reference while maintaining the original content. Owing to the locality in convolutional neural networks (CNNs), extracting …

DecoderStyle Transfer

PyramidStyler: Transformer-Based Neural Style Transfer with Pyramidal Positional Encoding and Reinforcement Learning

2025-10-02 · Raahul Krishna Durairaju, K. Saruladha arxiv

Neural Style Transfer (NST) has evolved from Gatys et al.'s (2015) CNN-based algorithm, enabling AI-driven artistic image synthesis. However, existing CNN and transformer-based models struggle to scale efficiently to com…

Reinforcement LearningStyle Transfer

A Hierarchical Reinforced Sequence Operation Method for Unsupervised Text Style Transfer

2019-06-05 · ACL 2019 7 · Chen Wu, Xuancheng Ren, Fuli Luo, Xu sun

Unsupervised text style transfer aims to alter text styles while preserving the content, without aligned data for supervision. Existing seq2seq methods face three challenges: 1) the transfer is weakly interpretable, 2) g…

SentenceStyle TransferText Style TransferUnsupervised Text Style Transfer