paper-with-me

Papers

Heaviside Low-Rank Support Matrix Machine

2026-02-28 · Xianchao Xiu, Shenghao Sun, Xinrong Li, Jiyuan Tao arxiv

Support matrix machine (SMM) is an emerging classification framework that directly handles matrix-structured observations, thereby avoiding the spatial correlations destroyed by vectorization. However, most existing SMM variants rely on convex or nonconvex surrogate loss functions, which may lead to high sensitivity to noise. To address this issue, we propose a novel Heaviside low-rank SMM model called HL-SMM, which leverages the Heaviside loss instead of the common hinge or ramp losses for robustness. Moreover, the low-rank constraint is adopted to accurately characterize the inherent global structure. In theory, we analyze the Karush-Kuhn-Tucker (KKT) points and rigorously prove the sufficient and necessary conditions. In algorithms, we develop an effective proximal alternating minimization (PAM) scheme, where all subproblems have closed-form solutions. Extensive experiments on benchmark datasets validate that the proposed HL-SMM achieves superior classification accuracy and robustness compared to state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2603.00491

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Memory capacity of two layer neural networks with smooth activations

2023-08-03 · Liam Madden, Christos Thrampoulidis

Determining the memory capacity of two layer neural networks with $m$ hidden neurons and input dimension $d$ (i.e., $md+2m$ total trainable parameters), which refers to the largest size of general data the network can me…

Low Rank Support Quaternion Matrix Machine

2025-12-09 · Wang Chen, Ziyan Luo, Shuangyue Wang arxiv

Input features are conventionally represented as vectors, matrices, or third order tensors in the real field, for color image classification. Inspired by the success of quaternion data modeling for color images in image …

Computational EfficiencyImage Classification

Aligning Multiclass Neural Network Classifier Criterion with Task Performance via $F_β$-Score

2024-05-31 · Nathan Tsoi, Deyuan Li, Taesoo Daniel Lee, Marynel Vázquez

Multiclass neural network classifiers are typically trained using cross-entropy loss. Following training, the performance of this same neural network is evaluated using an application-specific metric based on the multicl…

Binary Classification

Review of a Heaviside step sequence function and the recursive Heaviside step sequence function for modeling human mental state

2024-10-26 · Changsoo Shin

In this paper, we define a novel recursive Heaviside step sequence function and demonstrate its applicability to modeling human mental states such as thought processes, memory recall, and forgetfulness. By extending the …

On the expressivity of deep Heaviside networks

2025-04-30 · Insung Kong, Juntong Chen, Sophie Langer, Johannes Schmidt-Hieber

We show that deep Heaviside networks (DHNs) have limited expressiveness but that this can be overcome by including either skip connections or neurons with linear activation. We provide lower and upper bounds for the Vapn…

regression