paper-with-me

홈 › Papers

Block-Term Tensor Decomposition Model Selection and Computation: The Bayesian Way

2021-01-08 · Paris V. Giampouras, Athanasios A. Rontogiannis, Eleftherios Kofidis

The so-called block-term decomposition (BTD) tensor model, especially in its rank-$(L_r,L_r,1)$ version, has been recently receiving increasing attention due to its enhanced ability of representing systems and signals that are composed of \emph{blocks} of rank higher than one, a scenario encountered in numerous and diverse applications. Uniqueness conditions and fitting methods have thus been thoroughly studied. Nevertheless, the challenging problem of estimating the BTD model structure, namely the number of block terms, $R$, and their individual ranks, $L_r$, has only recently started to attract significant attention, mainly through regularization-based approaches which entail the need to tune the regularization parameter(s). In this work, we build on ideas of sparse Bayesian learning (SBL) and put forward a fully automated Bayesian approach. Through a suitably crafted multi-level \emph{hierarchical} probabilistic model, which gives rise to heavy-tailed prior distributions for the BTD factors, structured sparsity is \emph{jointly} imposed. Ranks are then estimated from the numbers of blocks ($R$) and columns ($L_r$) of non-negligible energy. Approximate posterior inference is implemented, within the variational inference framework. The resulting iterative algorithm completely avoids hyperparameter tuning, which is a significant defect of regularization-based methods. Alternative probabilistic models are also explored and the connections with their regularization-based counterparts are brought to light with the aid of the associated maximum a-posteriori (MAP) estimators. We report simulation results with both synthetic and real-word data, which demonstrate the merits of the proposed method in terms of both rank estimation and model fitting as compared to state-of-the-art relevant methods.

📄 PDF Abstract BibTeX arXiv:2101.02931

Code (0)

등록된 구현이 없습니다.

Tasks

Model SelectionTensor DecompositionVariational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음

Similar Papers 제목 키워드 기반

A Biased Nonnegative Block Term Tensor Decomposition Model for Dynamic QoS Prediction

2026-05-06 · Wenjing Liu, Yujia Lei, Qu Wang arxiv

With the rapid development of cloud computing and Web services, Quality of Service (QoS) has become a key criterion for service selection and recommendation. Tensor latent feature analysis provides an effective way to mo…

Fast Learnings of Coupled Nonnegative Tensor Decomposition Using Optimal Gradient and Low-rank Approximation

2023-02-10 · XiuLin Wang, Jing Liu, FengYu Cong

Tensor decomposition is a fundamental technique widely applied in signal processing, machine learning, and various other fields. However, traditional tensor decomposition methods encounter limitations when jointly analyz…

EEGTensor Decomposition

Core consistency diagnosis for Block Term Decomposition in rank $(L_r, L_r, 1)$

2023-12-18 · Noramon Dron, Javier Escudero

Determining the underlying number of components $R$ in tensor decompositions is challenging. Diverse techniques exist for various decompositions, notably the core consistency diagnostic (CORCONDIA) for Canonical Polyadic…

Diagnostic

Kronecker CP Decomposition with Fast Multiplication for Compressing RNNs

2020-08-21 · Dingheng Wang, Bijiao Wu, Guangshe Zhao, Man Yao 외

Recurrent neural networks (RNNs) are powerful in the tasks oriented to sequential data, such as natural language processing and video recognition. However, since the modern RNNs, including long-short term memory (LSTM) a…

Tensor DecompositionVideo Recognition

WinNet: Make Only One Convolutional Layer Effective for Time Series Forecasting

2023-11-01 · Wenjie Ou, Zhishuo Zhao, Dongyue Guo, Zheng Zhang 외

Deep learning models have recently achieved significant performance improvements in time series forecasting. We present a highly accurate and simply structured CNN-based model with only one convolutional layer, called Wi…

Time SeriesTime Series Forecasting