HyperReal: Complex-Valued Layer Functions For Complex-Valued Scaling Invariance
Complex-valued measurements in MRI and SAR imaging often have complex-valued scaling ambiguity, calling for models that are invariant to complex-valued scaling of pixels. Deep Complex Networks (DCN) extends real-valued algebra to complex-valued algebra in neural networks, but it does not address the issue of complex-valued scaling. SurReal complex-valued networks adopt a manifold view of complex numbers and derive a distance metric that is invariant to complex scaling. With distance features, it achieves complex-scaling invariance. However, rich complex-valued information is lost in this representation, and additionally, SurReal is also prevented from using complex-valued non-linearity, limiting its expressive power. We simplify the manifold formulation of SurReal and propose a new layer function that achieves complex-scaling invariance within the complex domain. We can then build hierarchical complex-valued features with complex-scaling invariance. Our so-called HyperReal model results in a much leaner model with better generalization. Benchmarked on MSTAR, HyperReal beats DCN (and matches SurReal) with only 3%(40%) of their respective parameter counts.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
FCCNs: Fully Complex-valued Convolutional Networks using Complex-valued Color Model and Loss Function
Although complex-valued convolutional neural networks (iCNNs) have existed for a while, they lack proper complex-valued image inputs and loss functions. In addition, all their operations are not complex-valued as the…
image-classificationImage ClassificationLearning Representations Using Complex-Valued Nets
Complex-valued neural networks (CVNNs) are an emerging field of research in neural networks due to their potential representational properties for audio, image, and physiological signals. It is common in signal processin…
Representation LearningTime SeriesTime Series AnalysisCo-domain Symmetry for Complex-Valued Deep Learning
We study complex-valued scaling as a type of symmetry natural and unique to complex-valued measurements and representations. Deep Complex Networks (DCN) extends real-valued algebra to the complex domain without addressin…
Deep LearningTheory and Implementation of Complex-Valued Neural Networks
This work explains in detail the theory behind Complex-Valued Neural Network (CVNN), including Wirtinger calculus, complex backpropagation, and basic modules such as complex layers, complex activation functions, or compl…
Complex-valued Neurons Can Learn More but Slower than Real-valued Neurons via Gradient Descent
Complex-valued neural networks potentially possess better representations and performance than real-valued counterparts when dealing with some complicated tasks such as acoustic analysis, radar image classification, etc.…