paper-with-me

홈 › Papers

MANGO: Learning Disentangled Image Transformation Manifolds with Grouped Operators

2024-09-14 · Brighton Ancelin, Yenho Chen, Peimeng Guan, Chiraag Kaushik, Belen Martin-Urcelay, Alex Saad-Falcon, Nakul Singh

Learning semantically meaningful image transformations (i.e. rotation, thickness, blur) directly from examples can be a challenging task. Recently, the Manifold Autoencoder (MAE) proposed using a set of Lie group operators to learn image transformations directly from examples. However, this approach has limitations, as the learned operators are not guaranteed to be disentangled and the training routine is prohibitively expensive when scaling up the model. To address these limitations, we propose MANGO (transformation Manifolds with Grouped Operators) for learning disentangled operators that describe image transformations in distinct latent subspaces. Moreover, our approach allows practitioners the ability to define which transformations they aim to model, thus improving the semantic meaning of the learned operators. Through our experiments, we demonstrate that MANGO enables composition of image transformations and introduces a one-phase training routine that leads to a 100x speedup over prior works.

📄 PDF Abstract BibTeX arXiv:2409.09542

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Learning Group Actions In Disentangled Latent Image Representations

2025-12-03 · Farhana Hossain Swarnali, Miaomiao Zhang, Tonmoy Hossain arxiv

Modeling group actions on latent representations enables controllable transformations of high-dimensional image data. Prior works applying group-theoretic priors or modeling transformations typically operate in the high-…

Eelgrass beds and oyster farming at a lagoon before and after the Great East Japan Earthquake 2011: potential to apply deep learning at a coastal area

2019-09-06 · Takehisa Yamakita

There is a small number of case studies of automatic land cover classification on the coastal area. Here, I test extraction of seagrass beds, sandy area, oyster farming rafts at Mangoku-ura Lagoon, Miyagi, Japan by compa…

General ClassificationImage SegmentationLand Cover ClassificationSand+2

MANGO: A Mask Attention Guided One-Stage Scene Text Spotter

2020-12-08 · Liang Qiao, Ying Chen, Zhanzhan Cheng, Yunlu Xu 외

Recently end-to-end scene text spotting has become a popular research topic due to its advantages of global optimization and high maintainability in real applications. Most methods attempt to develop various region of in…

Decoderglobal-optimizationPositionText Spotting

MangoLeafBD: A Comprehensive Image Dataset to Classify Diseased and Healthy Mango Leaves

2022-08-27 · Sarder Iftekhar Ahmed, Muhammad Ibrahim, Md. Nadim, Md. Mizanur Rahman 외

Agriculture is of one of the few remaining sectors that is yet to receive proper attention from the machine learning community. The importance of datasets in the machine learning discipline cannot be overemphasized. The …

Multi-Level Variational Autoencoder: Learning Disentangled Representations from Grouped Observations

2017-05-24 · Diane Bouchacourt, Ryota Tomioka, Sebastian Nowozin

We would like to learn a representation of the data which decomposes an observation into factors of variation which we can independently control. Specifically, we want to use minimal supervision to learn a latent represe…

Disentanglement