paper-with-me

Papers

HyperReal: Complex-Valued Layer Functions For Complex-Valued Scaling Invariance

2021-01-01 · Utkarsh Singhal, Yifei Xing, Stella Yu

Complex-valued measurements in MRI and SAR imaging often have complex-valued scaling ambiguity, calling for models that are invariant to complex-valued scaling of pixels. Deep Complex Networks (DCN) extends real-valued algebra to complex-valued algebra in neural networks, but it does not address the issue of complex-valued scaling. SurReal complex-valued networks adopt a manifold view of complex numbers and derive a distance metric that is invariant to complex scaling. With distance features, it achieves complex-scaling invariance. However, rich complex-valued information is lost in this representation, and additionally, SurReal is also prevented from using complex-valued non-linearity, limiting its expressive power. We simplify the manifold formulation of SurReal and propose a new layer function that achieves complex-scaling invariance within the complex domain. We can then build hierarchical complex-valued features with complex-scaling invariance. Our so-called HyperReal model results in a much leaner model with better generalization. Benchmarked on MSTAR, HyperReal beats DCN (and matches SurReal) with only 3%(40%) of their respective parameter counts.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

FCCNs: Fully Complex-valued Convolutional Networks using Complex-valued Color Model and Loss Function

2023-01-01 · ICCV 2023 1 · Saurabh Yadav, Koteswar Rao Jerripothula

Although complex-valued convolutional neural networks (iCNNs) have existed for a while, they lack proper complex-valued image inputs and loss functions. In addition, all their operations are not complex-valued as the…

image-classificationImage Classification

Learning Representations Using Complex-Valued Nets

2015-11-19 · Andy M. Sarroff, Victor Shepardson, Michael A. Casey

Complex-valued neural networks (CVNNs) are an emerging field of research in neural networks due to their potential representational properties for audio, image, and physiological signals. It is common in signal processin…

Representation LearningTime SeriesTime Series Analysis

Co-domain Symmetry for Complex-Valued Deep Learning

2021-12-02 · CVPR 2022 1 · Utkarsh Singhal, Yifei Xing, Stella X. Yu

We study complex-valued scaling as a type of symmetry natural and unique to complex-valued measurements and representations. Deep Complex Networks (DCN) extends real-valued algebra to the complex domain without addressin…

Deep Learning

Theory and Implementation of Complex-Valued Neural Networks

2023-02-16 · Jose Agustin Barrachina, Chengfang Ren, Gilles Vieillard, Christele Morisseau 외

This work explains in detail the theory behind Complex-Valued Neural Network (CVNN), including Wirtinger calculus, complex backpropagation, and basic modules such as complex layers, complex activation functions, or compl…

Complex-valued Neurons Can Learn More but Slower than Real-valued Neurons via Gradient Descent

2023-09-21 · NeurIPS 2023 11

Complex-valued neural networks potentially possess better representations and performance than real-valued counterparts when dealing with some complicated tasks such as acoustic analysis, radar image classification, etc.…