paper-with-me

홈 › Papers

On the Reconstruction of Training Data from Group Invariant Networks

2024-11-25 · Ran Elbaz, Gilad Yehudai, Meirav Galun, Haggai Maron

Reconstructing training data from trained neural networks is an active area of research with significant implications for privacy and explainability. Recent advances have demonstrated the feasibility of this process for several data types. However, reconstructing data from group-invariant neural networks poses distinct challenges that remain largely unexplored. This paper addresses this gap by first formulating the problem and discussing some of its basic properties. We then provide an experimental evaluation demonstrating that conventional reconstruction techniques are inadequate in this scenario. Specifically, we observe that the resulting data reconstructions gravitate toward symmetric inputs on which the group acts trivially, leading to poor-quality results. Finally, we propose two novel methods aiming to improve reconstruction in this setup and present promising preliminary experimental results. Our work sheds light on the complexities of reconstructing data from group invariant neural networks and offers potential avenues for future research in this domain.

📄 PDF Abstract BibTeX arXiv:2411.16458

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Unsupervised Learning of Group Invariant and Equivariant Representations

2022-02-15 · Robin Winter, Marco Bertolini, Tuan Le, Frank Noé 외

Equivariant neural networks, whose hidden features transform according to representations of a group G acting on the data, exhibit training efficiency and an improved generalisation performance. In this work, we extend g…

DecoderRepresentation Learningvalid

Invariants of objects and their images under surjective maps

2015-09-22 · Irina A. Kogan, Peter J. Olver

We examine the relationships between the differential invariants of objects and of their images under a surjective map. We analyze both the case when the underlying transformation group is projectable and hence induces a…

A semidiscrete version of the Citti-Petitot-Sarti model as a plausible model for anthropomorphic image reconstruction and pattern recognition

2017-04-10 · Dario Prandi, Jean-Paul Gauthier

In his beautiful book [66], Jean Petitot proposes a sub-Riemannian model for the primary visual cortex of mammals. This model is neurophysiologically justified. Further developments of this theory lead to efficient algor…

Image Reconstruction

Euclidean and Affine Curve Reconstruction

2022-01-24 · Jose Agudelo, Brooke Dippold, Ian Klein, Alex Kokot 외

We consider practical aspects of reconstructing planar curves with prescribed Euclidean or affine curvatures. These curvatures are invariant under the special Euclidean group and the equi-affine groups, respectively, and…

Equivariant neural networks for inverse problems

2021-02-23 · Elena Celledoni, Matthias J. Ehrhardt, Christian Etmann, Brynjulf Owren 외

In recent years the use of convolutional layers to encode an inductive bias (translational equivariance) in neural networks has proven to be a very fruitful idea. The successes of this approach have motivated a line of r…

Inductive Bias