paper-with-me

Papers

Unsupervised Path Representation Learning with Curriculum Negative Sampling

2021-06-17 · Sean Bin Yang, Chenjuan Guo, Jilin Hu, Jian Tang, Bin Yang

Path representations are critical in a variety of transportation applications, such as estimating path ranking in path recommendation systems and estimating path travel time in navigation systems. Existing studies often learn task-specific path representations in a supervised manner, which require a large amount of labeled training data and generalize poorly to other tasks. We propose an unsupervised learning framework Path InfoMax (PIM) to learn generic path representations that work for different downstream tasks. We first propose a curriculum negative sampling method, for each input path, to generate a small amount of negative paths, by following the principles of curriculum learning. Next, \emph{PIM} employs mutual information maximization to learn path representations from both a global and a local view. In the global view, PIM distinguishes the representations of the input paths from those of the negative paths. In the local view, \emph{PIM} distinguishes the input path representations from the representations of the nodes that appear only in the negative paths. This enables the learned path representations to encode both global and local information at different scales. Extensive experiments on two downstream tasks, ranking score estimation and travel time estimation, using two road network datasets suggest that PIM significantly outperforms other unsupervised methods and is also able to be used as a pre-training method to enhance supervised path representation learning.

📄 PDF Abstract BibTeX arXiv:2106.09373

Code (1)

Sean-Bin-Yang/Path-InfoMax 공식 구현 pytorch

Tasks

Recommendation SystemsRepresentation LearningTravel Time Estimation

Methods 이 논문이 사용한 방법론

Travel 설명 없음

Similar Papers 제목 키워드 기반

ConCur: Self-supervised graph representation based on contrastive learning with curriculum negative sampling

2023-09-01 · journal 2023 9 · Rong Yan, Peng Bao

Contrastive learning has made breakthrough advancements in graph representation learning, which encourages the representation of positive samples to be close and those of negative samples to be far away. However, existin…

Contrastive LearningGraph Representation LearningNode ClassificationRepresentation Learning+1

Weakly-supervised Temporal Path Representation Learning with Contrastive Curriculum Learning -- Extended Version

2022-03-30 · Sean Bin Yang, Chenjuan Guo, Jilin Hu, Bin Yang 외

In step with the digitalization of transportation, we are witnessing a growing range of path-based smart-city applications, e.g., travel-time estimation and travel path ranking. A temporal path(TP) that includes temporal…

Contrastive LearningRepresentation LearningTravel Time Estimation

Unsupervised Contrastive Learning of Image Representations from Ultrasound Videos with Hard Negative Mining

2022-07-26 · Soumen Basu, Somanshu Singla, Mayank Gupta, Pratyaksha Rana 외

Rich temporal information and variations in viewpoints make video data an attractive choice for learning image representations using unsupervised contrastive learning (UCL) techniques. State-of-the-art (SOTA) contrastive…

Contrastive Learning

Clustering-Aware Negative Sampling for Unsupervised Sentence Representation

2023-05-17 · Jinghao Deng, Fanqi Wan, Tao Yang, Xiaojun Quan 외

Contrastive learning has been widely studied in sentence representation learning. However, earlier works mainly focus on the construction of positive examples, while in-batch samples are often simply treated as negative …

ClusteringContrastive LearningRepresentation LearningSemantic Textual Similarity+2

CuSINeS: Curriculum-driven Structure Induced Negative Sampling for Statutory Article Retrieval

2024-03-31 · T. Y. S. S Santosh, Kristina Kaiser, Matthias Grabmair

In this paper, we introduce CuSINeS, a negative sampling approach to enhance the performance of Statutory Article Retrieval (SAR). CuSINeS offers three key contributions. Firstly, it employs a curriculum-based negative s…

Retrieval