paper-with-me

홈 › Papers

Non-Neighbors Also Matter to Kriging: A New Contrastive-Prototypical Learning

2024-01-23 · Zhishuai Li, Yunhao Nie, Ziyue Li, Lei Bai, Yisheng Lv, Rui Zhao

Kriging aims at estimating the attributes of unsampled geo-locations from observations in the spatial vicinity or physical connections, which helps mitigate skewed monitoring caused by under-deployed sensors. Existing works assume that neighbors' information offers the basis for estimating the attributes of the unobserved target while ignoring non-neighbors. However, non-neighbors could also offer constructive information, and neighbors could also be misleading. To this end, we propose ``Contrastive-Prototypical'' self-supervised learning for Kriging (KCP) to refine valuable information from neighbors and recycle the one from non-neighbors. As a pre-trained paradigm, we conduct the Kriging task from a new perspective of representation: we aim to first learn robust and general representations and then recover attributes from representations. A neighboring contrastive module is designed that coarsely learns the representations by narrowing the representation distance between the target and its neighbors while pushing away the non-neighbors. In parallel, a prototypical module is introduced to identify similar representations via exchanged prediction, thus refining the misleading neighbors and recycling the useful non-neighbors from the neighboring contrast component. As a result, not all the neighbors and some of the non-neighbors will be used to infer the target. To encourage the two modules above to learn general and robust representations, we design an adaptive augmentation module that incorporates data-driven attribute augmentation and centrality-based topology augmentation over the spatiotemporal Kriging graph data. Extensive experiments on real-world datasets demonstrate the superior performance of KCP compared to its peers with 6% improvements and exceptional transferability and robustness. The code is available at https://github.com/bonaldli/KCP

📄 PDF Abstract BibTeX arXiv:2401.12681

Code (1)

bonaldli/kcp 공식 구현 pytorch

Tasks

AttributeSelf-Supervised Learning

Similar Papers 제목 키워드 기반

Spatial Aggregation and Temporal Convolution Networks for Real-time Kriging

2021-09-24 · Yuankai Wu, Dingyi Zhuang, MengYing Lei, Aurelie Labbe 외

Spatiotemporal kriging is an important application in spatiotemporal data analysis, aiming to recover/interpolate signals for unsampled/unobserved locations based on observed signals. The principle challenge for spatiote…

Rethinking Prototypical Contrastive Learning through Alignment, Uniformity and Correlation

2022-10-18 · Shentong Mo, Zhun Sun, Chao Li

Contrastive self-supervised learning (CSL) with a prototypical regularization has been introduced in learning meaningful representations for downstream tasks that require strong semantic information. However, to optimize…

Contrastive LearningDiversitySelf-Supervised Learning

Bridge to Target Domain by Prototypical Contrastive Learning and Label Confusion: Re-explore Zero-Shot Learning for Slot Filling

2021-10-07 · EMNLP 2021 11 · LiWen Wang, Xuefeng Li, Jiachi Liu, Keqing He 외

Zero-shot cross-domain slot filling alleviates the data dependence in the case of data scarcity in the target domain, which has aroused extensive research. However, as most of the existing methods do not achieve effectiv…

Contrastive Learningslot-fillingSlot FillingTransfer Learning+2

Rational Kriging

2023-12-08 · V. Roshan Joseph

This article proposes a new kriging that has a rational form. It is shown that the generalized least squares estimate of the mean from rational kriging is much more well behaved than that from ordinary kriging. Parameter…

parameter estimationUncertainty Quantification

DarkFarseer: Inductive Spatio-temporal Kriging via Hidden Style Enhancement and Sparsity-Noise Mitigation

2025-01-06 · Zhuoxuan Liang, Wei Li, Dalin Zhang, Yidan Chen 외

With the rapid growth of the Internet of Things and Cyber-Physical Systems, widespread sensor deployment has become essential. However, the high costs of building sensor networks limit their scale and coverage, making fi…

Contrastive LearningDenoisinggraph constructionStyle Transfer