paper-with-me

Papers

Hound: Hunting Supervision Signals for Few and Zero Shot Node Classification on Text-attributed Graph

2024-09-01 · Yuxiang Wang, Xiao Yan, Shiyu Jin, Quanqing Xu, Chuanhui Yang, Yuanyuan Zhu, Chuang Hu, Bo Du, Jiawei Jiang

Text-attributed graph (TAG) is an important type of graph structured data with text descriptions for each node. Few- and zero-shot node classification on TAGs have many applications in fields such as academia and social networks. However, the two tasks are challenging due to the lack of supervision signals, and existing methods only use the contrastive loss to align graph-based node embedding and language-based text embedding. In this paper, we propose Hound to improve accuracy by introducing more supervision signals, and the core idea is to go beyond the node-text pairs that come with data. Specifically, we design three augmentation techniques, i.e., node perturbation, text matching, and semantics negation to provide more reference nodes for each text and vice versa. Node perturbation adds/drops edges to produce diversified node embeddings that can be matched with a text. Text matching retrieves texts with similar embeddings to match with a node. Semantics negation uses a negative prompt to construct a negative text with the opposite semantics, which is contrasted with the original node and text. We evaluate Hound on 5 datasets and compare with 13 state-of-the-art baselines. The results show that Hound consistently outperforms all baselines, and its accuracy improvements over the best-performing baseline are usually over 5%.

📄 PDF Abstract BibTeX arXiv:2409.00727

Code (0)

등록된 구현이 없습니다.

Tasks

NegationNode ClassificationTAGText Matching

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Age-at-harvest models as monitoring and harvest management tools for Wisconsin carnivores

2018-11-15

Quantifying and estimating wildlife population sizes is a foundation of wildlife management. However, many carnivore species are cryptic, leading to innate difficulties in estimating their populations. We evaluated the p…

ManagementState Space Models

Zero-Shot Unsupervised and Text-Based Audio Editing Using DDPM Inversion

2024-02-15 · Hila Manor, Tomer Michaeli

Editing signals using large pre-trained models, in a zero-shot manner, has recently seen rapid advancements in the image domain. However, this wave has yet to reach the audio domain. In this paper, we explore two zero-sh…

Liberating Seen Classes: Boosting Few-Shot and Zero-Shot Text Classification via Anchor Generation and Classification Reframing

2024-05-06 · Han Liu, Siyang Zhao, Xiaotong Zhang, Feng Zhang 외

Few-shot and zero-shot text classification aim to recognize samples from novel classes with limited labeled samples or no labeled samples at all. While prevailing methods have shown promising performance via transferring…

Binary ClassificationClassificationLanguage ModellingMulti-class Classification+3

QA-Driven Zero-shot Slot Filling with Weak Supervision Pretraining

2021-08-01 · ACL 2021 5 · Xinya Du, Luheng He, Qi Li, Dian Yu 외

Slot-filling is an essential component for building task-oriented dialog systems. In this work, we focus on the zero-shot slot-filling problem, where the model needs to predict slots and their values, given utterances fr…

slot-fillingSlot FillingZero-shot Slot Filling

BELT:Bootstrapping Electroencephalography-to-Language Decoding and Zero-Shot Sentiment Classification by Natural Language Supervision

2023-09-21 · Jinzhao Zhou, Yiqun Duan, Yu-Cheng Chang, Yu-Kai Wang 외

This paper presents BELT, a novel model and learning framework for the pivotal topic of brain-to-language translation research. The translation from noninvasive brain signals into readable natural language has the potent…

Brain DecodingContrastive LearningEEGQuantization+6