paper-with-me

Papers

Mesh Convolutional Autoencoder for Semi-Regular Meshes of Different Sizes

2021-10-18 · Sara Hahner, Jochen Garcke

The analysis of deforming 3D surface meshes is accelerated by autoencoders since the low-dimensional embeddings can be used to visualize underlying dynamics. But, state-of-the-art mesh convolutional autoencoders require a fixed connectivity of all input meshes handled by the autoencoder. This is due to either the use of spectral convolutional layers or mesh dependent pooling operations. Therefore, the types of datasets that one can study are limited and the learned knowledge cannot be transferred to other datasets that exhibit similar behavior. To address this, we transform the discretization of the surfaces to semi-regular meshes that have a locally regular connectivity and whose meshing is hierarchical. This allows us to apply the same spatial convolutional filters to the local neighborhoods and to define a pooling operator that can be applied to every semi-regular mesh. We apply the same mesh autoencoder to different datasets and our reconstruction error is more than 50% lower than the error from state-of-the-art models, which have to be trained for every mesh separately. Additionally, we visualize the underlying dynamics of unseen mesh sequences with an autoencoder trained on different classes of meshes.

📄 PDF Abstract BibTeX arXiv:2110.09401

Code (1)

fraunhofer-scai/conv_sr_mesh_autoencoder 공식 구현 pytorch

Similar Papers 제목 키워드 기반

Transfer Learning using Spectral Convolutional Autoencoders on Semi-Regular Surface Meshes

2022-12-12 · Sara Hahner, Felix Kerkhoff, Jochen Garcke

The underlying dynamics and patterns of 3D surface meshes deforming over time can be discovered by unsupervised learning, especially autoencoders, which calculate low-dimensional embeddings of the surfaces. To study the …

Transfer Learning

Convolutional Neural Network on Semi-Regular Triangulated Meshes and its Application to Brain Image Data

2019-03-21 · Caoqiang Liu, Hui Ji, Anqi Qiu

We developed a convolution neural network (CNN) on semi-regular triangulated meshes whose vertices have 6 neighbours. The key blocks of the proposed CNN, including convolution and down-sampling, are directly defined in a…

Fully Convolutional Mesh Autoencoder using Efficient Spatially Varying Kernels

2020-06-08 · NeurIPS 2020 12 · Yi Zhou, Chenglei Wu, Zimo Li, Chen Cao 외

Learning latent representations of registered meshes is useful for many 3D tasks. Techniques have recently shifted to neural mesh autoencoders. Although they demonstrate higher precision than traditional methods, they re…

DEMEA: Deep Mesh Autoencoders for Non-Rigidly Deforming Objects

2019-05-24 · ECCV 2020 8 · Edgar Tretschk, Ayush Tewari, Michael Zollhöfer, Vladislav Golyanik 외

Mesh autoencoders are commonly used for dimensionality reduction, sampling and mesh modeling. We propose a general-purpose DEep MEsh Autoencoder (DEMEA) which adds a novel embedded deformation layer to a graph-convolutio…

3D ReconstructionDimensionality Reduction

Dual Mesh Convolutional Networks for Human Shape Correspondence

2021-03-23 · Nitika Verma, Adnane Boukhayma, Jakob Verbeek, Edmond Boyer

Convolutional networks have been extremely successful for regular data structures such as 2D images and 3D voxel grids. The transposition to meshes is, however, not straight-forward due to their irregular structure. We e…

3D Shape Representation