paper-with-me

홈 › Papers

Adaptive Pruning for Increased Robustness and Reduced Computational Overhead in Gaussian Process Accelerated Saddle Point Searches

2025-10-07 · Rohit Goswami, Hannes Jónsson arxiv

Gaussian process (GP) regression provides a strategy for accelerating saddle point searches on high-dimensional energy surfaces by reducing the number of times the energy and its derivatives with respect to atomic coordinates need to be evaluated. The computational overhead in the hyperparameter optimization can, however, be large and make the approach inefficient. Failures can also occur if the search ventures too far into regions that are not represented well enough by the GP model. Here, these challenges are resolved by using geometry-aware optimal transport measures and an active pruning strategy using a summation over Wasserstein-1 distances for each atom-type in farthest-point sampling, selecting a fixed-size subset of geometrically diverse configurations to avoid rapidly increasing cost of GP updates as more observations are made. Stability is enhanced by permutation-invariant metric that provides a reliable trust radius for early-stopping and a logarithmic barrier penalty for the growth of the signal variance. These physically motivated algorithmic changes prove their efficacy by reducing to less than a half the mean computational time on a set of 238 challenging configurations from a previously published data set of chemical reactions. With these improvements, the GP approach is established as, a robust and scalable algorithm for accelerating saddle point searches when the evaluation of the energy and atomic forces requires significant computational effort.

📄 PDF Abstract BibTeX arXiv:2510.06030

Code (0)

등록된 구현이 없습니다.

Tasks

Hyperparameter Optimization

Similar Papers 제목 키워드 기반

Rethinking Visual Dependency in Long-Context Reasoning for Large Vision-Language Models

2024-10-25 · Yucheng Zhou, Zhi Rao, Jun Wan, Jianbing Shen

Large Vision-Language Models (LVLMs) excel in cross-model tasks but experience performance declines in long-context reasoning due to overreliance on textual information and reduced visual dependency. In this study, we em…

Architecture-aware Network Pruning for Vision Quality Applications

2019-08-05 · Wei-Ting Wang, Han-Lin Li, Wei-Shiang Lin, Cheng-Ming Chiang 외

Convolutional neural network (CNN) delivers impressive achievements in computer vision and machine learning field. However, CNN incurs high computational complexity, especially for vision quality applications because of …

Network PruningSuper-Resolution

$μ$-MoE: Test-Time Pruning as Micro-Grained Mixture-of-Experts

2025-05-24 · Toshiaki Koike-Akino, Jing Liu, Ye Wang

To tackle the huge computational demand of large foundation models, activation-aware compression techniques without retraining have been introduced. However, since these rely on calibration data, domain shift may arise f…

Mixture-of-Experts

Layer Pruning with Consensus: A Triple-Win Solution

2024-11-21 · Leandro Giusti Mugnaini, Carolina Tavares Duarte, Anna H. Reali Costa, Artur Jordao

Layer pruning offers a promising alternative to standard structured pruning, effectively reducing computational costs, latency, and memory footprint. While notable layer-pruning approaches aim to detect unimportant layer…

Sample-aware Adaptive Structured Pruning for Large Language Models

2025-03-08 · Jun Kong, Xinge Ma, Jin Wang, Xuejie Zhang

Large language models (LLMs) have achieved outstanding performance in natural language processing, but enormous model sizes and high computational costs limit their practical deployment. Structured pruning can effectivel…

Bayesian Optimization