paper-with-me

홈 › Papers

Multi-Level Network Embedding with Boosted Low-Rank Matrix Approximation

2018-08-26 · ASONAM 2019 2019 11 · Jundong Li, Liang Wu, Huan Liu

As opposed to manual feature engineering which is tedious and difficult to scale, network representation learning has attracted a surge of research interests as it automates the process of feature learning on graphs. The learned low-dimensional node vector representation is generalizable and eases the knowledge discovery process on graphs by enabling various off-the-shelf machine learning tools to be directly applied. Recent research has shown that the past decade of network embedding approaches either explicitly factorize a carefully designed matrix to obtain the low-dimensional node vector representation or are closely related to implicit matrix factorization, with the fundamental assumption that the factorized node connectivity matrix is low-rank. Nonetheless, the global low-rank assumption does not necessarily hold especially when the factorized matrix encodes complex node interactions, and the resultant single low-rank embedding matrix is insufficient to capture all the observed connectivity patterns. In this regard, we propose a novel multi-level network embedding framework BoostNE, which can learn multiple network embedding representations of different granularity from coarse to fine without imposing the prevalent global low-rank assumption. The proposed BoostNE method is also in line with the successful gradient boosting method in ensemble learning as multiple weak embeddings lead to a stronger and more effective one. We assess the effectiveness of the proposed BoostNE framework by comparing it with existing state-of-the-art network embedding methods on various datasets, and the experimental results corroborate the superiority of the proposed BoostNE network embedding framework.

📄 PDF Abstract BibTeX arXiv:1808.08627

Code (2)

benedekrozemberczki/BoostedFactorization
benedekrozemberczki/karateclub

Tasks

Ensemble LearningFeature EngineeringNetwork EmbeddingRepresentation Learning

Similar Papers 제목 키워드 기반

Alibaba at IJCNLP-2017 Task 2: A Boosted Deep System for Dimensional Sentiment Analysis of Chinese Phrases

2017-12-01 · IJCNLP 2017 12 · Xin Zhou, Jian Wang, Xu Xie, Changlong Sun 외

This paper introduces Team Alibaba{'}s systems participating IJCNLP 2017 shared task No. 2 Dimensional Sentiment Analysis for Chinese Phrases (DSAP). The systems mainly utilize a multi-layer neural networks, with multipl…

ClusteringFeature EngineeringPart-Of-Speech TaggingPrediction+2

End-to-End Neural Ad-hoc Ranking with Kernel Pooling

2017-06-20 · Chenyan Xiong, Zhuyun Dai, Jamie Callan, Zhiyuan Liu 외

This paper proposes K-NRM, a kernel based neural model for document ranking. Given a query and a set of documents, K-NRM uses a translation matrix that models word-level similarities via word embeddings, a new kernel-poo…

Ad-Hoc Information RetrievalDocument RankingLearning-To-RankTranslation+1

Estimating the Hessian Matrix of Ranking Objectives for Stochastic Learning to Rank with Gradient Boosted Trees

2024-04-18 · Jingwei Kang, Maarten de Rijke, Harrie Oosterhuis

Stochastic learning to rank (LTR) is a recent branch in the LTR field that concerns the optimization of probabilistic ranking models. Their probabilistic behavior enables certain ranking qualities that are impossible wit…

FairnessLearning-To-Rank

Boosted Stochastic Frank-Wolfe for Constrained Nonconvex Optimization

2026-05-24 · Navil Nandhan, Abbas Khademi, Antonio Silveti-Falls arxiv

The boosted Frank-Wolfe algorithm accelerates the classical Frank-Wolfe algorithm by better aligning the update direction with the negative gradient. Its analysis, however, has been limited to deterministic convex proble…

Factor Fitting, Rank Allocation, and Partitioning in Multilevel Low Rank Matrices

2023-10-30 · Tetiana Parshakova, Trevor Hastie, Eric Darve, Stephen Boyd

We consider multilevel low rank (MLR) matrices, defined as a row and column permutation of a sum of matrices, each one a block diagonal refinement of the previous one, with all blocks low rank given in factored form. MLR…