paper-with-me

Papers

Unsupervised Part Segmentation through Disentangling Appearance and Shape

2021-05-26 · CVPR 2021 1 · Shilong Liu, Lei Zhang, Xiao Yang, Hang Su, Jun Zhu

We study the problem of unsupervised discovery and segmentation of object parts, which, as an intermediate local representation, are capable of finding intrinsic object structure and providing more explainable recognition results. Recent unsupervised methods have greatly relaxed the dependency on annotated data which are costly to obtain, but still rely on additional information such as object segmentation mask or saliency map. To remove such a dependency and further improve the part segmentation performance, we develop a novel approach by disentangling the appearance and shape representations of object parts followed with reconstruction losses without using additional object mask information. To avoid degenerated solutions, a bottleneck block is designed to squeeze and expand the appearance representation, leading to a more effective disentanglement between geometry and appearance. Combined with a self-supervised part classification loss and an improved geometry concentration constraint, we can segment more consistent parts with semantic meanings. Comprehensive experiments on a wide variety of objects such as face, bird, and PASCAL VOC objects demonstrate the effectiveness of the proposed method.

📄 PDF Abstract BibTeX arXiv:2105.12405

Code (0)

등록된 구현이 없습니다.

Tasks

DisentanglementObjectSegmentationSemantic SegmentationUnsupervised Facial Landmark Detection

Similar Papers 제목 키워드 기반

Unsupervised Part-Based Disentangling of Object Shape and Appearance

2019-03-16 · CVPR 2019 6 · Dominik Lorenz, Leonard Bereska, Timo Milbich, Björn Ommer

Large intra-class variation is the result of changes in multiple object characteristics. Images, however, only show the superposition of different variable factors such as appearance or shape. Therefore, learning to dise…

Appearance TransferImage GenerationObjectPose Prediction+3

Deforming Autoencoders: Unsupervised Disentangling of Shape and Appearance

2018-06-18 · ECCV 2018 9 · Zhixin Shu, Mihir Sahasrabudhe, Alp Guler, Dimitris Samaras 외

In this work we introduce Deforming Autoencoders, a generative model for images that disentangles shape from appearance in an unsupervised manner. As in the deformable template paradigm, shape is represented as a deforma…

Unsupervised Facial Landmark Detection

Unsupervised Disentangling of Appearance and Geometry by Deformable Generator Network

2019-06-01 · CVPR 2019 6 · Xianglei Xing, Tian Han, Ruiqi Gao, Song-Chun Zhu 외

We present a deformable generator model to disentangle the appearance and geometric information in purely unsupervised manner. The appearance generator models the appearance related information, including color, illumina…

Transfer Learning

Unsupervised Discovery of 3D Physical Objects from Video

2020-07-24 · Yilun Du, Kevin Smith, Tomer Ulman, Joshua Tenenbaum 외

We study the problem of unsupervised physical object discovery. While existing frameworks aim to decompose scenes into 2D segments based off each object's appearance, we explore how physics, especially object interaction…

3D geometryObjectObject DiscoveryPosition

LAVAE: Disentangling Location and Appearance

2019-09-25 · Andrea Dittadi, Ole Winther

We propose a probabilistic generative model for unsupervised learning of structured, interpretable, object-based representations of visual scenes. We use amortized variational inference to train the generative model end-…

ObjectVariational Inference