An Outer-approximation Guided Optimization Approach for Constrained Neural Network Inverse Problems
This paper discusses an outer-approximation guided optimization method for constrained neural network inverse problems with rectified linear units. The constrained neural network inverse problems refer to an optimization problem to find the best set of input values of a given trained neural network in order to produce a predefined desired output in presence of constraints on input values. This paper analyzes the characteristics of optimal solutions of neural network inverse problems with rectified activation units and proposes an outer-approximation algorithm by exploiting their characteristics. The proposed outer-approximation guided optimization comprises primal and dual phases. The primal phase incorporates neighbor curvatures with neighbor outer-approximations to expedite the process. The dual phase identifies and utilizes the structure of local convex regions to improve the convergence to a local optimal solution. At last, computation experiments demonstrate the superiority of the proposed algorithm compared to a projected gradient method.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Dimension reduction for derivative-informed operator learning: An analysis of approximation errors
We study the derivative-informed learning of nonlinear operators between infinite-dimensional separable Hilbert spaces by neural networks. Such operators can arise from the solution of partial differential equations (PDE…
Dimensionality ReductionExperimental DesignOperator learningA Fully Single Loop Algorithm for Bilevel Optimization without Hessian Inverse
In this paper, we propose a new Hessian inverse free Fully Single Loop Algorithm (FSLA) for bilevel optimization problems. Classic algorithms for bilevel optimization admit a double loop structure which is computationall…
Bilevel OptimizationA Two-Timescale Framework for Bilevel Optimization: Complexity Analysis and Application to Actor-Critic
This paper analyzes a two-timescale stochastic algorithm framework for bilevel optimization. Bilevel optimization is a class of problems which exhibit a two-level structure, and its goal is to minimize an outer objective…
Bilevel OptimizationHyperparameter OptimizationBi-level Guided Diffusion Models for Zero-Shot Medical Imaging Inverse Problems
In the realm of medical imaging, inverse problems aim to infer high-quality images from incomplete, noisy measurements, with the objective of minimizing expenses and risks to patients in clinical settings. The Diffusion …
Computed Tomography (CT)Learning of Patch-Based Smooth-Plus-Sparse Models for Image Reconstruction
We aim at the solution of inverse problems in imaging, by combining a penalized sparse representation of image patches with an unconstrained smooth one. This allows for a straightforward interpretation of the reconstruct…
compressed sensingDenoisingImage ReconstructionSuper-Resolution