paper-with-me

홈 › Papers

Hop Sampling: A Simple Regularized Graph Learning for Non-Stationary Environments

2020-06-26 · Young-Jin Park, Kyuyong Shin, Kyung-Min Kim

Graph representation learning is gaining popularity in a wide range of applications, such as social networks analysis, computational biology, and recommender systems. However, different with positive results from many academic studies, applying graph neural networks (GNNs) in a real-world application is still challenging due to non-stationary environments. The underlying distribution of streaming data changes unexpectedly, resulting in different graph structures (a.k.a., concept drift). Therefore, it is essential to devise a robust graph learning technique so that the model does not overfit to the training graphs. In this work, we present Hop Sampling, a straightforward regularization method that can effectively prevent GNNs from overfishing. The hop sampling randomly selects the number of propagation steps rather than fixing it, and by doing so, it encourages the model to learn meaningful node representation for all intermediate propagation layers and to experience a variety of plausible graphs that are not in the training set. Particularly, we describe the use case of our method in recommender systems, a representative example of the real-world non-stationary case. We evaluated hop sampling on a large-scale real-world LINE dataset and conducted an online A/B/n test in LINE Coupon recommender systems of LINE Wallet Tab. Experimental results demonstrate that the proposed scheme improves the prediction accuracy of GNNs. We observed hop sampling provides 7.97% and 16.93% improvements for NDCG and MAP compared to non-regularized GNN models in our online service. Furthermore, models using hop sampling alleviate the oversmoothing issue in GNNs enabling a deeper model as well as more diversified representation.

📄 PDF Abstract BibTeX arXiv:2006.14897

Code (0)

등록된 구현이 없습니다.

Tasks

Graph LearningGraph Representation LearningRecommendation SystemsRepresentation Learning

Similar Papers 제목 키워드 기반

Non-Stationary Bandit Learning via Predictive Sampling

2022-05-04 · Yueyang Liu, Xu Kuang, Benjamin Van Roy

Thompson sampling has proven effective across a wide range of stationary bandit environments. However, as we demonstrate in this paper, it can perform poorly when applied to non-stationary environments. We attribute such…

AttributeThompson Sampling

Unified Policy Optimization for Continuous-action Reinforcement Learning in Non-stationary Tasks and Games

2022-08-19 · Rong-Jun Qin, Fan-Ming Luo, Hong Qian, Yang Yu

This paper addresses policy learning in non-stationary environments and games with continuous actions. Rather than the classical reward maximization mechanism, inspired by the ideas of follow-the-regularized-leader (FTRL…

MuJoCoReinforcement Learning (RL)

Revisiting Non-Acyclic GFlowNets in Discrete Environments

2025-02-11 · Nikita Morozov, Ian Maksimov, Daniil Tiapkin, Sergey Samsonov

Generative Flow Networks (GFlowNets) are a family of generative models that learn to sample objects from a given probability distribution, potentially known up to a normalizing constant. Instead of working in the object …

A Broader View of Thompson Sampling

2025-10-08 · Yanlin Qu, Hongseok Namkoong, Assaf Zeevi arxiv

Thompson Sampling is one of the most widely used and studied bandit algorithms, known for its simple structure, low regret performance, and solid theoretical guarantees. Yet, in stark contrast to most other families of b…

Regularized M-estimators with nonconvexity: Statistical and algorithmic theory for local optima

2013-05-10 · NeurIPS 2013 12 · Po-Ling Loh, Martin J. Wainwright

We provide novel theoretical results regarding local optima of regularized $M$-estimators, allowing for nonconvexity in both loss and penalty functions. Under restricted strong convexity on the loss and suitable regulari…