paper-with-me

홈 › Papers

Solving engineering eigenvalue problems with neural networks using the Rayleigh quotient

2025-06-04 · Conor Rowan, John Evans, Kurt Maute, Alireza Doostan

From characterizing the speed of a thermal system's response to computing natural modes of vibration, eigenvalue analysis is ubiquitous in engineering. In spite of this, eigenvalue problems have received relatively little treatment compared to standard forward and inverse problems in the physics-informed machine learning literature. In particular, neural network discretizations of solutions to eigenvalue problems have seen only a handful of studies. Owing to their nonlinearity, neural network discretizations prevent the conversion of the continuous eigenvalue differential equation into a standard discrete eigenvalue problem. In this setting, eigenvalue analysis requires more specialized techniques. Using a neural network discretization of the eigenfunction, we show that a variational form of the eigenvalue problem called the "Rayleigh quotient" in tandem with a Gram-Schmidt orthogonalization procedure is a particularly simple and robust approach to find the eigenvalues and their corresponding eigenfunctions. This method is shown to be useful for finding sets of harmonic functions on irregular domains, parametric and nonlinear eigenproblems, and high-dimensional eigenanalysis. We also discuss the utility of harmonic functions as a spectral basis for approximating solutions to partial differential equations. Through various examples from engineering mechanics, the combination of the Rayleigh quotient objective, Gram-Schmidt procedure, and the neural network discretization of the eigenfunction is shown to offer unique advantages for handling continuous eigenvalue problems.

📄 PDF Abstract BibTeX arXiv:2506.04375

Code (0)

등록된 구현이 없습니다.

Tasks

Physics-informed machine learning

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

Similar Papers 제목 키워드 기반

Linear Constrained Rayleigh Quotient Optimization: Theory and Algorithms

2019-11-07 · Yunshen Zhou, Zhaojun Bai, Ren-cang Li

We consider the following constrained Rayleigh quotient optimization problem (CRQopt) $$ \min_{x\in \mathbb{R}^n} x^{T}Ax\,\,\mbox{subject to}\,\, x^{T}x=1\,\mbox{and}\,C^{T}x=b, $$ where $A$ is an $n\times n$ real symme…

ClusteringConstrained Clustering

Rayleigh EigenDirections (REDs): GAN latent space traversals for multidimensional features

2022-01-25 · Guha Balakrishnan, Raghudeep Gadde, Aleix Martinez, Pietro Perona

We present a method for finding paths in a deep generative model's latent space that can maximally vary one set of image features while holding others constant. Crucially, unlike past traversal approaches, ours can manip…

Rayleigh Quotient Graph Neural Networks for Graph-level Anomaly Detection

2023-10-04 · Xiangyu Dong, Xingyi Zhang, Sibo Wang

Graph-level anomaly detection has gained significant attention as it finds applications in various domains, such as cancer diagnosis and enzyme prediction. However, existing methods fail to capture the spectral propertie…

Anomaly DetectionGraph Neural Network

Grouped Variable Selection for Generalized Eigenvalue Problems

2021-05-28 · Jonathan Dan, Simon Geirnaert, Alexander Bertrand

Many problems require the selection of a subset of variables from a full set of optimization variables. The computational complexity of an exhaustive search over all possible subsets of variables is, however, prohibitive…

Variable Selection

Convergence beyond the over-parameterized regime using Rayleigh quotients

2023-01-19 · David A. R. Robin, Kevin Scaman, Marc Lelarge

In this paper, we present a new strategy to prove the convergence of deep learning architectures to a zero training (or even testing) loss by gradient flow. Our analysis is centered on the notion of Rayleigh quotients in…