On the Equivalence of Regression and Classification

2025-11-06 · Jayadeva, Naman Dwivedi, Hari Krishnan, N. M. Anoop Krishnan arxiv

A formal link between regression and classification has been tenuous. Even though the margin maximization term $\|w\|$ is used in support vector regression, it has at best been justified as a regularizer. We show that a regression problem with $M$ samples lying on a hyperplane has a one-to-one equivalence with a linearly separable classification task with $2M$ samples. We show that margin maximization on the equivalent classification task leads to a different regression formulation than traditionally used. Using the equivalence, we demonstrate a ``regressability'' measure, that can be used to estimate the difficulty of regressing a dataset, without needing to first learn a model for it. We use the equivalence to train neural networks to learn a linearizing map, that transforms input variables into a space where a linear regressor is adequate.

📄 PDF Abstract BibTeX arXiv:2511.04422

Code (0)

등록된 구현이 없습니다.

On the Equivalence between Online and Private Learnability beyond Binary Classification

2020-06-02 · NeurIPS 2020 12 · Young Hun Jung, Baekjin Kim, Ambuj Tewari

Alon et al. [2019] and Bun et al. [2020] recently showed that online learnability and private PAC learnability are equivalent in binary classification. We investigate whether this equivalence extends to multi-class class…

Binary Classification Classification General Classification Multi-class Classification+1

On the Functional Equivalence of TSK Fuzzy Systems to Neural Networks, Mixture of Experts, CART, and Stacking Ensemble Regression

2019-03-25 · Dongrui Wu, Chin-Teng Lin, Jian Huang, Zhigang Zeng

Fuzzy systems have achieved great success in numerous applications. However, there are still many challenges in designing an optimal fuzzy system, e.g., how to efficiently optimize its parameters, how to balance the trad…

BIG-bench Machine Learning Mixture-of-Experts regression

Equivalence of Learning Algorithms

2014-06-10 · Julien Audiffren, Hachem Kadri

The purpose of this paper is to introduce a concept of equivalence between machine learning algorithms. We define two notions of algorithmic equivalence, namely, weak and strong equivalence. These notions are of paramoun…

BIG-bench Machine Learning regression

On the approximation capability of GNNs in node classification/regression tasks

2021-06-16 · Giuseppe Alessio D'Inverno, Monica Bianchini, Maria Lucia Sampoli, Franco Scarselli

Graph Neural Networks (GNNs) are a broad class of connectionist models for graph processing. Recent studies have shown that GNNs can approximate any function on graphs, modulo the equivalence relation on graphs defined b…

Clustering Graph Classification Node Classification regression

Deterministic Gaussian Averaged Neural Networks

2020-06-10 · Ryan Campbell, Chris Finlay, Adam M. Oberman

We present a deterministic method to compute the Gaussian average of neural networks used in regression and classification. Our method is based on an equivalence between training with a particular regularized loss, and t…

Adversarial Robustness regression