paper-with-me

홈 › Papers

Complex-Valued Unitary Representations as Classification Heads for Improved Uncertainty Quantification in Deep Neural Networks

2026-02-17 · Akbar Anbar Jafari, Cagri Ozcinar, Gholamreza Anbarjafari arxiv

Modern deep neural networks achieve high predictive accuracy but remain poorly calibrated: their confidence scores do not reliably reflect the true probability of correctness. We propose a quantum-inspired classification head architecture that projects backbone features into a complex-valued Hilbert space and evolves them under a learned unitary transformation parameterised via the Cayley map. Through a controlled hybrid experimental design - training a single shared backbone and comparing lightweight interchangeable heads - we isolate the effect of complex-valued unitary representations on calibration. Our ablation study on CIFAR-10 reveals that the unitary magnitude head (complex features evolved under a Cayley unitary, read out via magnitude and softmax) achieves an Expected Calibration Error (ECE) of 0.0146, representing a 2.4x improvement over a standard softmax head (0.0355) and a 3.5x improvement over temperature scaling (0.0510). Surprisingly, replacing the softmax readout with a Born rule measurement layer - the quantum-mechanically motivated approach - degrades calibration to an ECE of 0.0819. On the CIFAR-10H human-uncertainty benchmark, the wave function head achieves the lowest KL-divergence (0.336) to human soft labels among all compared methods, indicating that complex-valued representations better capture the structure of human perceptual ambiguity. We provide theoretical analysis connecting norm-preserving unitary dynamics to calibration through feature-space geometry, report negative results on out-of-distribution detection and sentiment analysis to delineate the method's scope, and discuss practical implications for safety-critical applications. Code is publicly available.

📄 PDF Abstract BibTeX arXiv:2602.15283

Code (0)

등록된 구현이 없습니다.

Tasks

Out-of-Distribution DetectionSentiment Analysis

Similar Papers 제목 키워드 기반

Complex Evolution Recurrent Neural Networks (ceRNNs)

2019-06-05 · Izhak Shafran, Tom Bagby, R. J. Skerry-Ryan

Unitary Evolution Recurrent Neural Networks (uRNNs) have three attractive properties: (a) the unitary property, (b) the complex-valued nature, and (c) their efficient linear operators. The literature so far does not addr…

speech-recognitionSpeech Recognition

Optical Phase Dropout in Diffractive Deep Neural Network

2020-11-28 · Yong-Liang Xiao

Unitary learning is a backpropagation that serves to unitary weights update in deep complex-valued neural network with full connections, meeting a physical unitary prior in diffractive deep neural network ([DN]2). Howeve…

Design of Discrete-time Matrix All-Pass Filters Using Subspace Nevanlinna Pick Interpolation

2022-10-25 · Agulla Surya Bharath, Devanshu Singh Gaharwar, Kumar Appaiah, Debasattam Pal

Unitary matrix-valued functions of frequency are matrix all-pass systems, since they preserve the norm of the input vector signals. Typically, such systems are represented and analyzed using their unitary-matrix valued f…

All

Deep Learning by Scattering

2013-06-24 · Stéphane Mallat, Irène Waldspurger

We introduce general scattering transforms as mathematical models of deep neural networks with l2 pooling. Scattering networks iteratively apply complex valued unitary operators, and the pooling is performed by a complex…

Deep LearningGeneral Classification

Quantum Kolmogorov--Arnold representation theorem for continuous unitary-valued maps

2026-07-03 · Sviatoslav V. Dzhenzher arxiv

The classical Kolmogorov--Arnold representation theorem states that any continuous multivariate function can be exactly decomposed into a finite composition of univariate continuous functions and addition operations. Thi…