paper-with-me

Papers

On the Identification and Optimization of Nonsmooth Superposition Operators in Semilinear Elliptic PDEs

2023-06-08 · Constantin Christof, Julia Kowalczyk

We study an infinite-dimensional optimization problem that aims to identify the Nemytskii operator in the nonlinear part of a prototypical semilinear elliptic partial differential equation (PDE) which minimizes the distance between the PDE-solution and a given desired state. In contrast to previous works, we consider this identification problem in a low-regularity regime in which the function inducing the Nemytskii operator is a-priori only known to be an element of $H^1_{loc}(\mathbb{R})$. This makes the studied problem class a suitable point of departure for the rigorous analysis of training problems for learning-informed PDEs in which an unknown superposition operator is approximated by means of a neural network with nonsmooth activation functions (ReLU, leaky-ReLU, etc.). We establish that, despite the low regularity of the controls, it is possible to derive a classical stationarity system for local minimizers and to solve the considered problem by means of a gradient projection method. The convergence of the resulting algorithm is proven in the function space setting. It is also shown that the established first-order necessary optimality conditions imply that locally optimal superposition operators share various characteristic properties with commonly used activation functions: They are always sigmoidal, continuously differentiable away from the origin, and typically possess a distinct kink at zero. The paper concludes with numerical experiments which confirm the theoretical findings.

📄 PDF Abstract BibTeX arXiv:2306.05185

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Learning Semilinear Neural Operators : A Unified Recursive Framework For Prediction And Data Assimilation

2024-02-24 · Ashutosh Singh, Ricardo Augusto Borsoi, Deniz Erdogmus, Tales Imbiriba

Recent advances in the theory of Neural Operators (NOs) have enabled fast and accurate computation of the solutions to complex systems described by partial differential equations (PDEs). Despite their great success, curr…

Nonsmoothness in Machine Learning: specific structure, proximal identification, and applications

2020-10-02 · Franck Iutzeler, Jérôme Malick

Nonsmoothness is often a curse for optimization; but it is sometimes a blessing, in particular for applications in machine learning. In this paper, we present the specific structure of nonsmooth optimization problems app…

BIG-bench Machine LearningDimensionality Reduction

Holographic Automata for Ambient Immersive A. I. via Reservoir Computing

2018-06-09 · Theophanes E. Raptis

We prove the existence of a semilinear representation of Cellular Automata (CA) with the introduction of multiple convolution kernels. Examples of the technique are presented for rules akin to the "edge-of-chaos" includi…

Distributed Computing

Anderson Acceleration in Nonsmooth Problems: Local Convergence via Active Manifold Identification

2024-10-12 · Kexin Li, Luwei Bai, Xiao Wang, Hao Wang

Anderson acceleration is an effective technique for enhancing the efficiency of fixed-point iterations; however, analyzing its convergence in nonsmooth settings presents significant challenges. In this paper, we investig…

Solving high-dimensional eigenvalue problems using deep neural networks: A diffusion Monte Carlo like approach

2020-02-07 · Jiequn Han, Jianfeng Lu, Mo Zhou

We propose a new method to solve eigenvalue problems for linear and semilinear second order differential operators in high dimensions based on deep neural networks. The eigenvalue problem is reformulated as a fixed point…