paper-with-me

홈 › Papers

Fast Disentangled Slim Tensor Learning for Multi-view Clustering

2024-11-12 · Deng Xu, Chao Zhang, Zechao Li, Chunlin Chen, Huaxiong Li

Tensor-based multi-view clustering has recently received significant attention due to its exceptional ability to explore cross-view high-order correlations. However, most existing methods still encounter some limitations. (1) Most of them explore the correlations among different affinity matrices, making them unscalable to large-scale data. (2) Although some methods address it by introducing bipartite graphs, they may result in sub-optimal solutions caused by an unstable anchor selection process. (3) They generally ignore the negative impact of latent semantic-unrelated information in each view. To tackle these issues, we propose a new approach termed fast Disentangled Slim Tensor Learning (DSTL) for multi-view clustering . Instead of focusing on the multi-view graph structures, DSTL directly explores the high-order correlations among multi-view latent semantic representations based on matrix factorization. To alleviate the negative influence of feature redundancy, inspired by robust PCA, DSTL disentangles the latent low-dimensional representation into a semantic-unrelated part and a semantic-related part for each view. Subsequently, two slim tensors are constructed with tensor-based regularization. To further enhance the quality of feature disentanglement, the semantic-related representations are aligned across views through a consensus alignment indicator. Our proposed model is computationally efficient and can be solved effectively. Extensive experiments demonstrate the superiority and efficiency of DSTL over state-of-the-art approaches. The code of DSTL is available at https://github.com/dengxu-nju/DSTL.

📄 PDF Abstract BibTeX arXiv:2411.07685

Code (1)

dengxu-nju/dstl 공식 구현

Tasks

ClusteringDisentanglement

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

DeepRebirth: Accelerating Deep Neural Network Execution on Mobile Devices

2017-08-16 · Dawei Li, Xiaolong Wang, Deguang Kong

Deploying deep neural networks on mobile devices is a challenging task. Current model compression methods such as matrix decomposition effectively reduce the deployed model size, but still cannot satisfy real-time proces…

CPUModel Compression

SlimmeRF: Slimmable Radiance Fields

2023-12-15 · Shiran Yuan, Hao Zhao

Neural Radiance Field (NeRF) and its variants have recently emerged as successful methods for novel view synthesis and 3D scene reconstruction. However, most current NeRF models either achieve high accuracy using large m…

3D Scene ReconstructionNeRFNovel View Synthesis

Exact Tensor Completion Powered by Slim Transforms

2024-02-02 · Li Ge, Lin Chen, Yudong Chen, Xue Jiang

In this work, a tensor completion problem is studied, which aims to perfectly recover the tensor from partial observations. The existing theoretical guarantee requires the involved transform to be orthogonal, which hinde…

Low Tensor-Rank Adaptation of Kolmogorov--Arnold Networks

2025-02-10 · Yihang Gao, Michael K. Ng, Vincent Y. F. Tan

Kolmogorov--Arnold networks (KANs) have demonstrated their potential as an alternative to multi-layer perceptions (MLPs) in various domains, especially for science-related tasks. However, transfer learning of KANs remain…

image-classificationImage ClassificationKolmogorov-Arnold NetworksTransfer Learning

SLIM-QN: A Stochastic, Light, Momentumized Quasi-Newton Optimizer for Deep Neural Networks

2021-09-29 · Yue Niu, Zalan Fabian, Sunwoo Lee, Mahdi Soltanolkotabi 외

We propose SLIM-QN, a light stochastic quasi-Newton optimizer for training large-scale deep neural networks (DNNs). SLIM-QN addresses two key barriers in existing second-order methods for large-scale DNNs: 1) the high co…

Second-order methods