paper-with-me

홈 › Papers

Compositional Neural Textures

2024-04-18 · Peihan Tu, Li-Yi Wei, Matthias Zwicker

Texture plays a vital role in enhancing visual richness in both real photographs and computer-generated imagery. However, the process of editing textures often involves laborious and repetitive manual adjustments of textons, which are the recurring local patterns that characterize textures. This work introduces a fully unsupervised approach for representing textures using a compositional neural model that captures individual textons. We represent each texton as a 2D Gaussian function whose spatial support approximates its shape, and an associated feature that encodes its detailed appearance. By modeling a texture as a discrete composition of Gaussian textons, the representation offers both expressiveness and ease of editing. Textures can be edited by modifying the compositional Gaussians within the latent space, and new textures can be efficiently synthesized by feeding the modified Gaussians through a generator network in a feed-forward manner. This approach enables a wide range of applications, including transferring appearance from an image texture to another image, diversifying textures,texture interpolation, revealing/modifying texture variations, edit propagation, texture animation, and direct texton manipulation. The proposed approach contributes to advancing texture analysis, modeling, and editing techniques, and opens up new possibilities for creating visually appealing images with controllable textures.

📄 PDF Abstract BibTeX arXiv:2404.12509

Code (0)

등록된 구현이 없습니다.

Tasks

Texture Classification

Similar Papers 제목 키워드 기반

RoomTex: Texturing Compositional Indoor Scenes via Iterative Inpainting

2024-06-04 · Qi Wang, Ruijie Lu, Xudong Xu, Jingbo Wang 외

The advancement of diffusion models has pushed the boundary of text-to-3D object generation. While it is straightforward to composite objects into a scene with reasonable geometry, it is nontrivial to texture such a scen…

Edge DetectionText to 3D

Describing Textures using Natural Language

2020-08-03 · ECCV 2020 8 · Chenyun Wu, Mikayla Timm, Subhransu Maji

Textures in natural images can be characterized by color, shape, periodicity of elements within them, and other attributes that can be described using natural language. In this paper, we study the problem of describing v…

AC-VLA: Robust Out-of-Distribution Action Execution via Compositional Learning

2026-07-17 · Xiaojiang Peng, Kai Peng, Jie Lu, Zheng Lian 외 arxiv

Vision-Language-Action (VLA) models excel at end-to-end robotic manipulation but struggle with out-of-distribution (OOD) generalization when familiar sub-tasks are recombined in unseen configurations. We identify two mut…

Pose-Guided Human Animation from a Single Image in the Wild

2020-12-07 · CVPR 2021 1 · Jae Shin Yoon, Lingjie Liu, Vladislav Golyanik, Kripasindhu Sarkar 외

We present a new pose transfer method for synthesizing a human animation from a single image of a person controlled by a sequence of body poses. Existing pose transfer methods exhibit significant visual artifacts when ap…

Human AnimationPose Transfer

Unified Perceptual Parsing for Scene Understanding

2018-07-26 · ECCV 2018 9 · Tete Xiao, Yingcheng Liu, Bolei Zhou, Yuning Jiang 외

Humans recognize the visual world at multiple levels: we effortlessly categorize scenes and detect objects inside, while also identifying the textures and surfaces of the objects along with their different compositional …

2D Semantic SegmentationScene UnderstandingSemantic Segmentation