Modifications to a classic BFGS library for use with SIMD-equipped hardware and an AAD library
We introduce certain modifications of the BFGS method for functions that are not parallelizable by nature (having consecutive operations only) taking advantage of SIMD. We also provide a modified LBFGS\texttt{++} library that takes advantage of these modifications, and the use of AAD, and give an interface for AAD users that takes advantage of the modified library automatically. We give two examples to illustrate the performance. The modified library is up to 3.8 times faster for European Swaption curve calibration in ORE (not parallelizable) and 1.4 times faster for calibrating the LMM model by a set of European options.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Implementation of Stochastic Quasi-Newton's Method in PyTorch
In this paper, we implement the Stochastic Damped LBFGS (SdLBFGS) for stochastic non-convex optimization. We make two important modifications to the original SdLBFGS algorithm. First, by initializing the Hessian at each …
Performance Optimization of Deep Learning Sparse Matrix Kernels on Intel Max Series GPU
In this paper, we focus on three sparse matrix operations that are relevant for machine learning applications, namely, the sparse-dense matrix multiplication (SPMM), the sampled dense-dense matrix multiplication (SDDMM),…
GPUA General SIMD-based Approach to Accelerating Compression Algorithms
Compression algorithms are important for data oriented tasks, especially in the era of Big Data. Modern processors equipped with powerful SIMD instruction sets, provide us an opportunity for achieving better compression …
TernGEMM: GEneral Matrix Multiply Library with Ternary Weights for Fast DNN Inference
Efficient implementation of deep neural networks on CPU-based systems is very critical because applications proliferate to embedded and Internet of Things (IoT) systems. Many CPUs for personal computers and embedded syst…
CPUchowdsp_wdf: An Advanced C++ Library for Wave Digital Circuit Modelling
chowdsp_wdf is a C++ library for implementing real-time wave digital models of analog circuits. chowdsp_wdf differs from existing wave digital modelling libraries by providing a template meta-programming interface for mo…