paper-with-me

Papers

SOC-ICNN: From Polyhedral to Conic Geometry for Learning Convex Surrogate Functions

2026-04-24 · Kang Liu, Jianchen Hu, Wei Peng arxiv

Classical ReLU-based Input Convex Neural Networks (ICNNs) are equivalent to the optimal value functions of Linear Programming (LP). This intrinsic structural equivalence restricts their representational capacity to piecewise-linear polyhedral functions. To overcome this representational bottleneck, we propose the SOC-ICNN, an architecture that generalizes the underlying optimization class from LP to Second-Order Cone Programming (SOCP). By explicitly injecting positive semi-definite curvature and Euclidean norm-based conic primitives, our formulation introduces native smooth curvature into the representation while preserving a rigorous optimization-theoretic interpretation. We formally prove that SOC-ICNNs strictly expand the representational space of ReLU-ICNNs without increasing the asymptotic order of forward-pass complexity. Extensive experiments demonstrate that SOC-ICNN substantially improves function approximation, while delivering competitive downstream decision quality. The code is available at https://anonymous.4open.science/r/SOC-ICNN-4B18/.

📄 PDF Abstract BibTeX arXiv:2604.22355

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Exact Dual Geometry of SOC-ICNN Value Functions

2026-05-06 · Kang Liu, Jianchen Hu, Wei Peng arxiv

Input Convex Neural Networks (ICNNs) are commonly used in a two-stage manner: one first trains a convex network and then minimizes it over its input in a downstream inference problem. Recent second-order-cone ICNNs (SOC-…

On the Depth of Monotone ReLU Neural Networks and ICNNs

2025-05-09 · Egor Bakaev, Florestan Brunck, Christoph Hertrich, Daniel Reichman 외

We study two models of ReLU neural networks: monotone networks (ReLU$^+$) and input convex neural networks (ICNN). Our focus is on expressivity, mostly in terms of depth, and we prove the following lower bounds. For the …

Deep Compact Polyhedral Conic Classifier for Open and Closed Set Recognition

2021-02-24 · Hakan Cevikalp, Bedirhan Uzun, Okan Köpüklü, Gurkan Ozturk

In this paper, we propose a new deep neural network classifier that simultaneously maximizes the inter-class separation and minimizes the intra-class variation by using the polyhedral conic classification function. The p…

Anomaly DetectionGeneral ClassificationOpen Set Learning

An Embedding Framework for Consistent Polyhedral Surrogates

2019-07-17 · NeurIPS 2019 12 · Jessie Finocchiaro, Rafael Frongillo, Bo Waggoner

We formalize and study the natural approach of designing convex surrogate loss functions via embeddings, for problems such as classification, ranking, or structured prediction. In this approach, one embeds each of the fi…

Structured Prediction

An Embedding Framework for the Design and Analysis of Consistent Polyhedral Surrogates

2022-06-29 · Jessie Finocchiaro, Rafael M. Frongillo, Bo Waggoner

We formalize and study the natural approach of designing convex surrogate loss functions via embeddings, for problems such as classification, ranking, or structured prediction. In this approach, one embeds each of the fi…

Structured Prediction