paper-with-me

Papers

Efficient Nonparametric Tensor Decomposition for Binary and Count Data

2024-01-15 · Zerui Tao, Toshihisa Tanaka, Qibin Zhao

In numerous applications, binary reactions or event counts are observed and stored within high-order tensors. Tensor decompositions (TDs) serve as a powerful tool to handle such high-dimensional and sparse data. However, many traditional TDs are explicitly or implicitly designed based on the Gaussian distribution, which is unsuitable for discrete data. Moreover, most TDs rely on predefined multi-linear structures, such as CP and Tucker formats. Therefore, they may not be effective enough to handle complex real-world datasets. To address these issues, we propose ENTED, an \underline{E}fficient \underline{N}onparametric \underline{TE}nsor \underline{D}ecomposition for binary and count tensors. Specifically, we first employ a nonparametric Gaussian process (GP) to replace traditional multi-linear structures. Next, we utilize the \pg augmentation which provides a unified framework to establish conjugate models for binary and count distributions. Finally, to address the computational issue of GPs, we enhance the model by incorporating sparse orthogonal variational inference of inducing points, which offers a more effective covariance approximation within GPs and stochastic natural gradient updates for nonparametric models. We evaluate our model on several real-world tensor completion tasks, considering binary and count datasets. The results manifest both better performance and computational advantages of the proposed model.

📄 PDF Abstract BibTeX arXiv:2401.07711

Code (1)

taozerui/gptd 공식 구현 pytorch

Tasks

Tensor DecompositionVariational Inference

Methods 이 논문이 사용한 방법론

GPS Greedy Policy Search (GPS) is a simple algorithm that learns a policy for test-time data augmentation based on the predictive performance on a validation set. GPS starts with…
TuckER TuckER
Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…
Variational Inference 설명 없음

Similar Papers 제목 키워드 기반

Composite Binary Decomposition Networks

2018-11-16 · You Qiaoben, Zheng Wang, Jianguo Li, Yinpeng Dong 외

Binary neural networks have great resource and computing efficiency, while suffer from long training procedure and non-negligible accuracy drops, when comparing to the full-precision counterparts. In this paper, we propo…

General Classificationimage-classificationImage Classificationobject-detection+2

Generalized Canonical Polyadic Tensor Decompositions with General Symmetry

2026-01-08 · Alex Mulrooney, David Hong arxiv

Canonical Polyadic (CP) tensor decomposition is a workhorse algorithm for discovering underlying low-dimensional structure in tensor data. This is accomplished in conventional CP decomposition by fitting a low-rank tenso…

Doubly Decomposing Nonparametric Tensor Regression

2015-06-19 · Masaaki Imaizumi, Kohei Hayashi

Nonparametric extension of tensor regression is proposed. Nonlinearity in a high-dimensional tensor space is broken into simple local functions by incorporating low-rank tensor decomposition. Compared to naive nonparamet…

regressionTensor Decomposition

Stochastic Nonparametric Event-Tensor Decomposition

2018-12-01 · NeurIPS 2018 12 · Shandian Zhe, Yishuai Du

Tensor decompositions are fundamental tools for multiway data analysis. Existing approaches, however, ignore the valuable temporal information along with data, or simply discretize them into time steps so that important …

Tensor Decomposition

Generalized Canonical Polyadic Tensor Decomposition

2018-08-22 · David Hong, Tamara G. Kolda, Jed A. Duersch

Tensor decomposition is a fundamental unsupervised machine learning method in data science, with applications including network analysis and sensor data processing. This work develops a generalized canonical polyadic (GC…

Tensor Decomposition