paper-with-me

홈 › Papers

Simple Disentanglement of Style and Content in Visual Representations

2023-02-20 · Lilian Ngweta, Subha Maity, Alex Gittens, Yuekai Sun, Mikhail Yurochkin

Learning visual representations with interpretable features, i.e., disentangled representations, remains a challenging problem. Existing methods demonstrate some success but are hard to apply to large-scale vision datasets like ImageNet. In this work, we propose a simple post-processing framework to disentangle content and style in learned representations from pre-trained vision models. We model the pre-trained features probabilistically as linearly entangled combinations of the latent content and style factors and develop a simple disentanglement algorithm based on the probabilistic model. We show that the method provably disentangles content and style features and verify its efficacy empirically. Our post-processed features yield significant domain generalization performance improvements when the distribution shift occurs due to style changes or style-related spurious correlations.

📄 PDF Abstract BibTeX arXiv:2302.09795

Code (1)

lilianngweta/pisco 공식 구현 pytorch

Tasks

DisentanglementDomain Generalization

Similar Papers 제목 키워드 기반

Contrastive-Augmented Flow Matching for Style-Content Disentanglement

2026-07-14 · Yusong Li, Pingchuan Ma, Ming Gui, Vincent Tao Hu 외 arxiv

Learning representations that separate content and style is crucial for controllable generation and compositional generalization. However, diffusion and flow-based models trained primarily with generative objectives ofte…

StyleDiffusion: Controllable Disentangled Style Transfer via Diffusion Models

2023-08-15 · ICCV 2023 1 · Zhizhong Wang, Lei Zhao, Wei Xing

Content and style (C-S) disentanglement is a fundamental problem and critical challenge of style transfer. Existing approaches based on explicit definitions (e.g., Gram matrix) or implicit learning (e.g., GANs) are neith…

DisentanglementStyle Transfer

Measuring the Biases and Effectiveness of Content-Style Disentanglement

2020-08-27 · Xiao Liu, Spyridon Thermos, Gabriele Valvano, Agisilaos Chartsias 외

A recent spate of state-of-the-art semi- and un-supervised solutions disentangle and encode image "content" into a spatial tensor and image appearance or "style" into a vector, to achieve good performance in spatially eq…

DisentanglementImage-to-Image Translation

InfoStyler: Disentanglement Information Bottleneck for Artistic Style Transfer

2023-07-30 · Yueming Lyu, Yue Jiang, Bo Peng, Jing Dong

Artistic style transfer aims to transfer the style of an artwork to a photograph while maintaining its original overall content. Many prior works focus on designing various transfer modules to transfer the style statisti…

DisentanglementRepresentation LearningStyle Transfer

VQ-Style: Disentangling Style and Content in Motion with Residual Quantized Representations

2026-02-02 · Fatemeh Zargarbashi, Dhruv Agrawal, Jakob Buhmann, Martin Guay 외 arxiv

Human motion data is inherently rich and complex, containing both semantic content and subtle stylistic features that are challenging to model. We propose a novel method for effective disentanglement of the style and con…

Contrastive LearningStyle Transfer