paper-with-me

홈 › Papers

Eigendecomposition-free Training of Deep Networks with Zero Eigenvalue-based Losses

2018-03-21 · ECCV 2018 9 · Zheng Dang, Kwang Moo Yi, Yinlin Hu, Fei Wang, Pascal Fua, Mathieu Salzmann

Many classical Computer Vision problems, such as essential matrix computation and pose estimation from 3D to 2D correspondences, can be solved by finding the eigenvector corresponding to the smallest, or zero, eigenvalue of a matrix representing a linear system. Incorporating this in deep learning frameworks would allow us to explicitly encode known notions of geometry, instead of having the network implicitly learn them from data. However, performing eigendecomposition within a network requires the ability to differentiate this operation. Unfortunately, while theoretically doable, this introduces numerical instability in the optimization process in practice. In this paper, we introduce an eigendecomposition-free approach to training a deep network whose loss depends on the eigenvector corresponding to a zero eigenvalue of a matrix predicted by the network. We demonstrate on several tasks, including keypoint matching and 3D pose estimation, that our approach is much more robust than explicit differentiation of the eigendecomposition, It has better convergence properties and yields state-of-the-art results on both tasks.

📄 PDF Abstract BibTeX arXiv:1803.08071

Code (0)

등록된 구현이 없습니다.

Tasks

3D Pose EstimationPose Estimation

Similar Papers 제목 키워드 기반

Eigendecomposition-Free Training of Deep Networks for Linear Least-Square Problems

2020-04-15 · Zheng Dang, Kwang Moo Yi, Yinlin Hu, Fei Wang 외

Many classical Computer Vision problems, such as essential matrix computation and pose estimation from 3D to 2D correspondences, can be tackled by solving a linear least-square problem, which can be done by finding the e…

DenoisingPose Estimation

When Slepian Meets Fiedler: Putting a Focus on the Graph Spectrum

2017-01-29 · Dimitri Van De Ville, Robin Demesmaeker, Maria Giulia Preti

The study of complex systems benefits from graph models and their analysis. In particular, the eigendecomposition of the graph Laplacian lets emerge properties of global organization from local interactions; e.g., the Fi…

ClusteringGraph Clustering

Negative eigenvalues of the Hessian in deep neural networks

2019-02-06 · Guillaume Alain, Nicolas Le Roux, Pierre-Antoine Manzagol

The loss function of deep networks is known to be non-convex but the precise nature of this nonconvexity is still an active area of research. In this work, we study the loss landscape of deep networks through the eigende…

Accelerated graph-based spectral polynomial filters

2015-09-08 · Andrew Knyazev, Alexander Malyshev

Graph-based spectral denoising is a low-pass filtering using the eigendecomposition of the graph Laplacian matrix of a noisy signal. Polynomial filtering avoids costly computation of the eigendecomposition by projections…

Denoising

Effective Eigendecomposition based Graph Adaptation for Heterophilic Networks

2021-07-28 · Vijay Lingam, Rahul Ragesh, Arun Iyer, Sundararajan Sellamanickam

Graph Neural Networks (GNNs) exhibit excellent performance when graphs have strong homophily property, i.e. connected nodes have the same labels. However, they perform poorly on heterophilic graphs. Several approaches ad…