paper-with-me

Papers

Sparse Tensor PCA via Tensor Decomposition for Unsupervised Feature Selection

2024-07-24 · Junjing Zheng, Xinyu Zhang, Weidong Jiang

Recently, introducing Tensor Decomposition (TD) methods into unsupervised feature selection (UFS) has been a rising research point. A tensor structure is beneficial for mining the relations between different modes and helps relieve the computation burden. However, while existing methods exploit TD to minimize the reconstruction error of a data tensor, they don't fully utilize the interpretable and discriminative information in the factor matrices. Moreover, most methods require domain knowledge to perform feature selection. To solve the above problems, we develop two Sparse Tensor Principal Component Analysis (STPCA) models that utilize the projection directions in the factor matrices to perform UFS. The first model extends Tucker Decomposition to a multiview sparse regression form and is transformed into several alternatively solved convex subproblems. The second model formulates a sparse version of the family of Tensor Singular Value Decomposition (T-SVDs) and is transformed into individual convex subproblems. For both models, we prove the optimal solution of each subproblem falls onto the Hermitian Positive Semidefinite Cone (HPSD). Accordingly, we design two fast algorithms based on HPSD projection and prove their convergence. According to the experimental results on two original synthetic datasets (Orbit and Array Signal) and five real-world datasets, the two proposed methods are suitable for handling different data tensor scenarios and outperform the state-of-the-art UFS methods.

📄 PDF Abstract BibTeX arXiv:2407.16985

Code (1)

zjj20212035/stpca 공식 구현

Tasks

feature selectionTensor Decomposition

Methods 이 논문이 사용한 방법론

TuckER TuckER
Feature Selection Feature selection, also known as variable selection, attribute selection or variable subset selection, is the process of selecting a subset of relevant features (variables,…

Similar Papers 제목 키워드 기반

E-commerce Anomaly Detection: A Bayesian Semi-Supervised Tensor Decomposition Approach using Natural Gradients

2018-04-11 · Anil R. Yelundur, Srinivasan H. Sengamedu, Bamdev Mishra

Anomaly Detection has several important applications. In this paper, our focus is on detecting anomalies in seller-reviewer data using tensor decomposition. While tensor-decomposition is mostly unsupervised, we formulate…

Anomaly DetectionData AugmentationTensor Decomposition

A Sparse Tensor Generator with Efficient Feature Extraction

2024-05-08 · Tugba Torun, Ameer Taweel, Didem Unat

Sparse tensor operations are increasingly important in diverse applications such as social networks, deep learning, diagnosis, crime, and review analysis. However, a major obstacle in sparse tensor research is the lack o…

Strivec: Sparse Tri-Vector Radiance Fields

2023-07-25 · ICCV 2023 1 · Quankai Gao, Qiangeng Xu, Hao Su, Ulrich Neumann 외

We propose Strivec, a novel neural representation that models a 3D scene as a radiance field with sparsely distributed and compactly factorized local tensor feature grids. Our approach leverages tensor decomposition, fol…

Tensor Decomposition

Supervised tensor decomposition with features on multiple modes

2019-10-21 · Jiaxin Hu, Chanwoo Lee, Miaoyan Wang

Higher-order tensors have received increased attention across science and engineering. While most tensor decomposition methods are developed for a single tensor observation, scientific studies often collect side informat…

Dimensionality ReductionTensor Decomposition

Tensor Decompositions: A New Concept in Brain Data Analysis?

2013-05-02 · Andrzej Cichocki

Matrix factorizations and their extensions to tensor factorizations and decompositions have become prominent techniques for linear and multilinear blind source separation (BSS), especially multiway Independent Component …

blind source separationClassificationClusteringDimensionality Reduction+2