paper-with-me

홈 › Papers

Stochastic Penalty-Barrier Methods for Constrained Machine Learning

2026-05-18 · Adam Bosák, Andrii Kliachkin, Jana Lepšová, Gilles Bareilles, Jakub Mareček arxiv

Constrained machine learning enables fairness-aware training, physics-informed neural networks, and integration of symbolic domain knowledge into statistical models. Despite its practical importance, no general method exists for the non-convex, non-smooth, stochastic setting that arises naturally in deep learning. We propose the Stochastic Penalty-Barrier Method (SPBM), which extends classical penalty and barrier methods to this setting via exponential dual averaging, a stabilized penalty schedule, and the Moreau envelope to handle non-smoothness. Experiments across multiple settings show that SPBM matches or outperforms existing constrained optimization baselines while incurring only linear runtime overhead compared to unconstrained Adam for up to 10,000 constraints.

📄 PDF Abstract BibTeX arXiv:2605.18618

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

The Stochastic Proximal Distance Algorithm

2022-10-21 · Haoyu Jiang, Jason Xu

Stochastic versions of proximal methods have gained much attention in statistics and machine learning. These algorithms tend to admit simple, scalable forms, and enjoy numerical stability via implicit updates. In this wo…

Stochastic Trust-Region Methods for Over-parameterized Models

2026-04-15 · Aike Yang, Hao Wang arxiv

Under interpolation-type assumptions such as the strong growth condition, stochastic optimization methods can attain convergence rates comparable to full-batch methods, but their performance, particularly for SGD, remain…

Stochastic Optimization

Constrained Reinforcement Learning with Smoothed Log Barrier Function

2024-03-21 · Baohe Zhang, Yuan Zhang, Lilli Frison, Thomas Brox 외

Reinforcement Learning (RL) has been widely applied to many control tasks and substantially improved the performances compared to conventional control methods in many domains where the reward function is well defined. Ho…

reinforcement-learningReinforcement LearningReinforcement Learning (RL)

Single-loop Algorithms for Stochastic Non-convex Optimization with Weakly-Convex Constraints

2025-04-21 · Ming Yang, Gang Li, Quanqi Hu, Qihang Lin 외

Constrained optimization with multiple functional inequality constraints has significant applications in machine learning. This paper examines a crucial subset of such problems where both the objective and constraint fun…

Continual LearningFairness

MoSSP: A Momentum-Based Single-Loop Stochastic Penalty Method for Nonconvex Constrained DC-Regularized Optimization

2026-05-28 · Luxuan Li, Chunfeng Cui, Xiao Wang arxiv

In this paper, we study a structured class of nonconvex constrained stochastic problems with difference-of-convex (DC) regularization, where the feasible set is possibly nonconvex and the concave part of the DC regulariz…