paper-with-me

홈 › Papers

mPOLICE: Provable Enforcement of Multi-Region Affine Constraints in Deep Neural Networks

2025-02-04 · Mohammadmehdi Ataei, Hyunmin Cheong, Adrian Butscher

Deep neural networks are increasingly employed in fields such as climate modeling, robotics, and industrial control, where strict output constraints must be upheld. Although prior methods like the POLICE algorithm can enforce affine constraints in a single convex region by adjusting network parameters, they struggle with multiple disjoint regions, often leading to conflicts or unintended affine extensions. We present mPOLICE, a new method that extends POLICE to handle constraints imposed on multiple regions. mPOLICE assigns a distinct activation pattern to each constrained region, preserving exact affine behavior locally while avoiding overreach into other parts of the input domain. We formulate a layer-wise optimization problem that adjusts both the weights and biases to assign unique activation patterns to each convex region, ensuring that constraints are met without conflicts, while maintaining the continuity and smoothness of the learned function. Our experiments show the enforcement of multi-region constraints for multiple scenarios, including regression and classification, function approximation, and non-convex regions through approximation. Notably, mPOLICE adds zero inference overhead and minimal training overhead.

📄 PDF Abstract BibTeX arXiv:2502.02434

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

POLICE: Provably Optimal Linear Constraint Enforcement for Deep Neural Networks

2022-11-02 · Randall Balestriero, Yann Lecun

Deep Neural Networks (DNNs) outshine alternative function approximators in many settings thanks to their modularity in composing any desired differentiable operator. The formed parametrized functional is then tuned to so…

CAffNet: Hard Constraint-Affine Neural Networks

2026-05-23 · Yang Zhao, Jungeun Lee, Jeong hwan Jeon, Sze Zheng Yong arxiv

We present a novel framework for embedding hard constraint satisfaction into neural network (NN) architectures, specifically feedforward neural networks and transformers, with input-dependent affine constraints of arbitr…

Expressivity Saturation: Reduced Affine Region Usage Under Increasing Task Complexity

2026-06-19 · Xuan Qi, Yi Wei, Fanqi Yu, Manuel Lecha arxiv

Piecewise-affine neural networks (e.g., with ReLU or LeakyReLU activations) implement continuous piecewise-affine maps, and the number of affine regions provides a natural proxy for expressive capacity. However, the gap …

AffineLens: Capturing the Continuous Piecewise Affine Functions of Neural Networks

2026-05-07 · Yi Wei, Xuan Qi, Furao Shen, Jian Zhao 외 arxiv

Piecewise affine neural networks (PANNs) provide a principled geometric perspective on neural network expressivity by characterizing the input--output map as a continuous piecewise affine (CPA) function whose complexity …

Lie Group Symmetry Discovery and Enforcement Using Vector Fields

2025-05-13 · Ben Shaw, Sasidhar Kunapuli, Abram Magner, Kevin R. Moon

Symmetry-informed machine learning can exhibit advantages over machine learning which fails to account for symmetry. Additionally, recent attention has been given to continuous symmetry discovery using vector fields whic…