paper-with-me

홈 › Papers

Non-Euclidean Broximal Point Method: A Blueprint for Geometry-Aware Optimization

2025-10-01 · Kaja Gruntkowska, Peter Richtárik arxiv

The recently proposed Broximal Point Method (BPM) [Gruntkowska et al., 2025] offers an idealized optimization framework based on iteratively minimizing the objective function over norm balls centered at the current iterate. It enjoys striking global convergence guarantees, converging linearly and in a finite number of steps for proper, closed and convex functions. However, its theoretical analysis has so far been confined to the Euclidean geometry. At the same time, emerging trends in deep learning optimization, exemplified by algorithms such as Muon [Jordan et al., 2024] and Scion [Pethick et al., 2025], demonstrate the practical advantages of minimizing over balls defined via non-Euclidean norms which better align with the underlying geometry of the associated loss landscapes. In this note, we ask whether the convergence theory of BPM can be extended to this more general, non-Euclidean setting. We give a positive answer, showing that most of the elegant guarantees of the original method carry over to arbitrary norm geometries. Along the way, we clarify which properties are preserved and which necessarily break down when leaving the Euclidean realm. Our analysis positions Non-Euclidean BPM as a conceptual blueprint for understanding a broad class of geometry-aware optimization algorithms, shedding light on the principles behind their practical effectiveness.

📄 PDF Abstract BibTeX arXiv:2510.00823

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

The Ball-Proximal (="Broximal") Point Method: a New Algorithm, Convergence Theory, and Applications

2025-02-04 · Kaja Gruntkowska, Hanmin Li, Aadi Rane, Peter Richtárik

Non-smooth and non-convex global optimization poses significant challenges across various applications, where standard gradient-based methods often struggle. We propose the Ball-Proximal Point Method, Broximal Point Meth…

global-optimization

Multi-scale Geometry-aware Transformer for 3D Point Cloud Classification

2023-04-12 · Xian Wei, Muyu Wang, Shing-Ho Jonathan Lin, Zhengyu Li 외

Self-attention modules have demonstrated remarkable capabilities in capturing long-range relationships and improving the performance of point cloud tasks. However, point cloud objects are typically characterized by compl…

3D Point Cloud ClassificationPoint Cloud Classification

Fisher SAM: Information Geometry and Sharpness Aware Minimisation

2022-06-10 · Minyoung Kim, Da Li, Shell Xu Hu, Timothy M. Hospedales

Recent sharpness-aware minimisation (SAM) is known to find flat minima which is beneficial for better generalisation with improved robustness. SAM essentially modifies the loss function by reporting the maximum loss valu…

GeoERM: Geometry-Aware Multi-Task Representation Learning on Riemannian Manifolds

2025-05-05 · Aoran Chen, Yang Feng

Multi-Task Learning (MTL) seeks to boost statistical power and learning efficiency by discovering structure shared across related tasks. State-of-the-art MTL representation methods, however, usually treat the latent repr…

Activity RecognitionMulti-Task LearningRepresentation Learning

Geometry-Aware Backdoor Attacks: Leveraging Curvature in Hyperbolic Embeddings

2025-10-07 · Ali Baheri arxiv

Non-Euclidean foundation models increasingly place representations in curved spaces such as hyperbolic geometry. We show that this geometry creates a boundary-driven asymmetry that backdoor triggers can exploit. Near the…