Intuitive Analysis of the Quantization-based Optimization: From Stochastic and Quantum Mechanical Perspective
In this paper, we present an intuitive analysis of the optimization technique based on the quantization of an objective function. Quantization of an objective function is an effective optimization methodology that decreases the measure of a level set containing several saddle points and local minima and finds the optimal point at the limit level set. To investigate the dynamics of quantization-based optimization, we derive an overdamped Langevin dynamics model from an intuitive analysis to minimize the level set by iterative quantization. We claim that quantization-based optimization involves the quantities of thermodynamical and quantum mechanical optimization as the core methodologies of global optimization. Furthermore, on the basis of the proposed SDE, we provide thermodynamic and quantum mechanical analysis with Witten-Laplacian. The simulation results with the benchmark functions, which compare the performance of the nonlinear optimization, demonstrate the validity of the quantization-based optimization.
Code (0)
등록된 구현이 없습니다.
Tasks
global-optimizationQuantizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Quantization-based Optimization with Perspective of Quantum Mechanics
Statistical and stochastic analysis based on thermodynamics has been the main analysis framework for stochastic global optimization. Recently, appearing quantum annealing or quantum tunneling algorithm for global optimiz…
global-optimizationQuantizationvalidQuantum mechanical framework for quantization-based optimization: from Gradient flow to Schroedinger equation
This work presents a quantum mechanical framework for analyzing quantization-based optimization algorithms. The sampling process of the quantization-based search is modeled as a gradient-flow dissipative system, leading …
Image ClassificationSampling-based sublinear low-rank matrix arithmetic framework for dequantizing quantum machine learning
We present an algorithmic framework for quantum-inspired classical algorithms on close-to-low-rank matrices, generalizing the series of results started by Tang's breakthrough quantum-inspired algorithm for recommendation…
BIG-bench Machine LearningClusteringQuantum Machine LearningRecommendation SystemsClassical and Quantum Speedups for Non-Convex Optimization via Energy Conserving Descent
The Energy Conserving Descent (ECD) algorithm was recently proposed (De Luca & Silverstein, 2022) as a global non-convex optimization method. Unlike gradient descent, appropriately configured ECD dynamics escape strict l…
Parcels of Universe or why Schr\"odinger and Fourier are so relatives?
This paper is about the surprising connection between the Fourier heat equation and the Schr\"odinger wave equation. In fact, if the independent "time" variable in the heat equation is replaced by the time variable multi…
Quantization