paper-with-me

홈 › Papers

Missing-Data-Induced Phase Transitions in Spectral PLS for Multimodal Learning

2026-01-29 · Anders Gjølbye, Ida Kargaard, Emma Kargaard, Lina Skerath, Lars Kai Hansen arxiv

Partial Least Squares (PLS) learns shared structure from paired data via the top singular vectors of the empirical cross-covariance (PLS-SVD), but multimodal datasets often have missing entries in both views. We study PLS-SVD under independent entry-wise missing-completely-at-random masking in a proportional high-dimensional spiked model. After appropriate normalization, the masked cross-covariance behaves like a spiked rectangular random matrix whose effective signal strength is attenuated by $\sqrtρ$, where $ρ$ is the joint entry retention probability. The replica-symmetric analysis predicts a sharp BBP-type phase transition: below a critical signal-to-noise threshold the leading singular vectors are asymptotically uninformative, while above it they achieve nontrivial alignment with the latent shared directions, with closed-form asymptotic overlap formulas. We also state a finite-rank extension as a conjecture, predicting that the same missingness-adjusted threshold applies componentwise when the latent spikes are separated. Simulations and semi-synthetic multimodal experiments agree with the predicted phase diagram and recovery curves across aspect ratios, signal strengths, and missingness levels.

📄 PDF Abstract BibTeX arXiv:2601.21294

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

DNA Torsion-based Model of Cell Fate Phase Transitions

2020-02-14

All stem cell fate transitions, including the metabolic reprogramming of stem cells and the somatic reprogramming of fibroblasts into pluripotent stem cells, can be understood from a unified theoretical model of cell fat…

Phase transitions in the mini-batch size for sparse and dense two-layer neural networks

2023-05-10 · Raffaele Marino, Federico Ricci-Tersenghi

The use of mini-batches of data in training artificial neural networks is nowadays very common. Despite its broad usage, theories explaining quantitatively how large or small the optimal mini-batch size should be are mis…

Continuous Phase Modulation of Phase Coded Transmit Waveforms using Multi-Tone Sinusoidal Frequency Modulation

2022-01-20 · David A. Hague

Phase Coded (PC) waveforms possess desirable Auto-Correlation Function (ACF) properties for use in radar and sonar systems. However, their spectra possess high spectral leakage due to the abrupt phase transitions between…

Phase Transitions in Spectral Community Detection of Large Noisy Networks

2015-04-09 · Pin-Yu Chen, Alfred O. Hero III

In this paper, we study the sensitivity of the spectral clustering based community detection algorithm subject to a Erdos-Renyi type random noise model. We prove phase transitions in community detectability as a function…

ClusteringCommunity Detection

From Density Matrices to Phase Transitions in Deep Learning: Spectral Early Warnings and Interpretability

2026-03-31 · Max Hennick, Guillaume Corlouer arxiv

A key problem in the modern study of AI is predicting and understanding emergent capabilities in models during training. Inspired by methods for studying reactions in quantum chemistry, we present the ``2-datapoint reduc…