paper-with-me

홈 › Papers

A Practical Second-order Latent Factor Model via Distributed Particle Swarm Optimization

2022-08-12 · Jialiang Wang, Yurong Zhong, Weiling Li

Latent Factor (LF) models are effective in representing high-dimension and sparse (HiDS) data via low-rank matrices approximation. Hessian-free (HF) optimization is an efficient method to utilizing second-order information of an LF model's objective function and it has been utilized to optimize second-order LF (SLF) model. However, the low-rank representation ability of a SLF model heavily relies on its multiple hyperparameters. Determining these hyperparameters is time-consuming and it largely reduces the practicability of an SLF model. To address this issue, a practical SLF (PSLF) model is proposed in this work. It realizes hyperparameter self-adaptation with a distributed particle swarm optimizer (DPSO), which is gradient-free and parallelized. Experiments on real HiDS data sets indicate that PSLF model has a competitive advantage over state-of-the-art models in data representation ability.

📄 PDF Abstract BibTeX arXiv:2208.06125

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Distributed Optimization via Energy Conservation Laws in Dilated Coordinates

2024-09-28 · Mayank Baranwal, Kushal Chakrabarti

Optimizing problems in a distributed manner is critical for systems involving multiple agents with private data. Despite substantial interest, a unified method for analyzing the convergence rates of distributed optimizat…

Distributed Optimization

Second-order Symmetric Non-negative Latent Factor Analysis

2022-03-04 · Weiling Li, Xin Luo

Precise representation of large-scale undirected network is the basis for understanding relations within a massive entity set. The undirected network representation task can be efficiently addressed by a symmetry non-neg…

Adaptive Cubic Regularized Second-Order Latent Factor Analysis Model

2025-07-03 · Jialiang Wang, Junzhou Wang, Xin Liao arxiv

High-dimensional and incomplete (HDI) data, characterized by massive node interactions, have become ubiquitous across various real-world applications. Second-order latent factor models have shown promising performance in…

PSLF: A PID Controller-incorporated Second-order Latent Factor Analysis Model for Recommender System

2024-08-31 · Jialiang Wang, Yan Xia, Ye Yuan

A second-order-based latent factor (SLF) analysis model demonstrates superior performance in graph representation learning, particularly for high-dimensional and incomplete (HDI) interaction data, by incorporating the cu…

Graph Representation LearningRecommendation SystemsRepresentation Learning

Scalable K-FAC Training for Deep Neural Networks with Distributed Preconditioning

2022-06-30 · Lin Zhang, Shaohuai Shi, Wei Wang, Bo Li

The second-order optimization methods, notably the D-KFAC (Distributed Kronecker Factored Approximate Curvature) algorithms, have gained traction on accelerating deep neural network (DNN) training on GPU clusters. Howeve…

GPU