Warped Convolutional Networks: Bridge Homography to sl(3) algebra by Group Convolution
Homography has an essential relationship with the special linear group and the embedding Lie algebra structure. Although the Lie algebra representation is elegant, few researchers have established the connection between homography and algebra expression in neural networks. In this paper, we propose Warped Convolution Networks (WCN) to effectively learn and represent the homography by SL(3) group and sl(3) algebra with group convolution. To this end, six commutative subgroups within the SL(3) group are composed to form a homography. For each subgroup, a warping function is proposed to bridge the Lie algebra structure to its corresponding parameters in homography. By taking advantage of the warped convolution, homography learning is formulated into several simple pseudo-translation regressions. By walking along the Lie topology, our proposed WCN is able to learn the features that are invariant to homography. Moreover, it can be easily plugged into other popular CNN-based methods. Extensive experiments on the POT benchmark, S-COCO-Proj, and MNIST-Proj dataset show that our proposed method is effective for planar object tracking, homography estimation, and classification.
Code (0)
등록된 구현이 없습니다.
Tasks
Homography EstimationObject TrackingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deep Image Homography Estimation
We present a deep convolutional neural network for estimating the relative homography between a pair of images. Our feed-forward network has 10 layers, takes two stacked grayscale images as input, and produces an 8 degre…
Homography EstimationPerceptual Loss for Robust Unsupervised Homography Estimation
Homography estimation is often an indispensable step in many computer vision tasks. The existing approaches, however, are not robust to illumination and/or larger viewpoint changes. In this paper, we propose bidirectiona…
Dataset GenerationHomography EstimationRepresentation LearningLie Neurons: Adjoint-Equivariant Neural Networks for Semisimple Lie Algebras
This paper proposes an equivariant neural network that takes data in any semi-simple Lie algebra as input. The corresponding group acts on the Lie algebra as adjoint operations, making our proposed network adjoint-equiva…
Point Cloud RegistrationGalois/monodromy groups for decomposing minimal problems in 3D reconstruction
We consider Galois/monodromy groups arising in computer vision applications, with a view towards building more efficient polynomial solvers. The Galois/monodromy group allows us to decide when a given problem decomposes …
3D ReconstructionHomography EstimationPose EstimationAlgebraic Convolutional Filters on Lie Group Algebras
Group convolutional neural networks are a useful tool for utilizing symmetries known to be in a signal; however, they require that the signal is defined on the group itself. Existing approaches either work directly with …