paper-with-me

Papers

Newton Method-based Subspace Support Vector Data Description

2023-09-25 · Fahad Sohrab, Firas Laakom, Moncef Gabbouj

In this paper, we present an adaptation of Newton's method for the optimization of Subspace Support Vector Data Description (S-SVDD). The objective of S-SVDD is to map the original data to a subspace optimized for one-class classification, and the iterative optimization process of data mapping and description in S-SVDD relies on gradient descent. However, gradient descent only utilizes first-order information, which may lead to suboptimal results. To address this limitation, we leverage Newton's method to enhance data mapping and data description for an improved optimization of subspace learning-based one-class classification. By incorporating this auxiliary information, Newton's method offers a more efficient strategy for subspace learning in one-class classification as compared to gradient-based optimization. The paper discusses the limitations of gradient descent and the advantages of using Newton's method in subspace learning for one-class classification tasks. We provide both linear and nonlinear formulations of Newton's method-based optimization for S-SVDD. In our experiments, we explored both the minimization and maximization strategies of the objective. The results demonstrate that the proposed optimization strategy outperforms the gradient-based S-SVDD in most cases.

📄 PDF Abstract BibTeX arXiv:2309.13960

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationOne-Class Classification

Similar Papers 제목 키워드 기반

Subspace Support Vector Data Description

2018-02-12 · Fahad Sohrab, Jenni Raitoharju, Moncef Gabbouj, Alexandros Iosifidis

This paper proposes a novel method for solving one-class classification problems. The proposed approach, namely Subspace Support Vector Data Description, maps the data to a subspace that is optimized for one-class classi…

ClassificationGeneral ClassificationOne-Class Classification

Graph-Embedded Subspace Support Vector Data Description

2021-04-29 · Fahad Sohrab, Alexandros Iosifidis, Moncef Gabbouj, Jenni Raitoharju

In this paper, we propose a novel subspace learning framework for one-class classification. The proposed framework presents the problem in the form of graph embedding. It includes the previously proposed subspace one-cla…

General ClassificationGraph EmbeddingOne-Class Classification

Ellipsoidal Subspace Support Vector Data Description

2020-03-20 · Fahad Sohrab, Jenni Raitoharju, Alexandros Iosifidis, Moncef Gabbouj

In this paper, we propose a novel method for transforming data into a low-dimensional space optimized for one-class classification. The proposed method iteratively transforms data into a new subspace optimized for ellips…

General ClassificationOne-Class Classification

Multimodal Subspace Support Vector Data Description

2019-04-16 · Fahad Sohrab, Jenni Raitoharju, Alexandros Iosifidis, Moncef Gabbouj

In this paper, we propose a novel method for projecting data from multiple modalities to a new subspace optimized for one-class classification. The proposed method iteratively transforms the data from the original featur…

AllGeneral ClassificationOne-Class Classification

Projected Stein Variational Newton: A Fast and Scalable Bayesian Inference Method in High Dimensions

2019-12-01 · NeurIPS 2019 12 · Peng Chen, Keyi Wu, Joshua Chen, Tom O'Leary-Roseberry 외

We propose a projected Stein variational Newton (pSVN) method for high-dimensional Bayesian inference. To address the curse of dimensionality, we exploit the intrinsic low-dimensional geometric structure of the posterior…

Bayesian Inference