paper-with-me

홈 › Papers

LEGO-Learn: Label-Efficient Graph Open-Set Learning

2024-10-21 · Haoyan Xu, Kay Liu, Zhengtao Yao, Philip S. Yu, Mengyuan Li, Kaize Ding, Yue Zhao

How can we train graph-based models to recognize unseen classes while keeping labeling costs low? Graph open-set learning (GOL) and out-of-distribution (OOD) detection aim to address this challenge by training models that can accurately classify known, in-distribution (ID) classes while identifying and handling previously unseen classes during inference. It is critical for high-stakes, real-world applications where models frequently encounter unexpected data, including finance, security, and healthcare. However, current GOL methods assume access to many labeled ID samples, which is unrealistic for large-scale graphs due to high annotation costs. In this paper, we propose LEGO-Learn (Label-Efficient Graph Open-set Learning), a novel framework that tackles open-set node classification on graphs within a given label budget by selecting the most informative ID nodes. LEGO-Learn employs a GNN-based filter to identify and exclude potential OOD nodes and then select highly informative ID nodes for labeling using the K-Medoids algorithm. To prevent the filter from discarding valuable ID examples, we introduce a classifier that differentiates between the C known ID classes and an additional class representing OOD nodes (hence, a C+1 classifier). This classifier uses a weighted cross-entropy loss to balance the removal of OOD nodes while retaining informative ID nodes. Experimental results on four real-world datasets demonstrate that LEGO-Learn significantly outperforms leading methods, with up to a 6.62% improvement in ID classification accuracy and a 7.49% increase in AUROC for OOD detection.

📄 PDF Abstract BibTeX arXiv:2410.16386

Code (1)

zhengtaoyao/lego 공식 구현 pytorch

Tasks

Node ClassificationOpen Set LearningOut of Distribution (OOD) Detection

Similar Papers 제목 키워드 기반

LEGOEval: An Open-Source Toolkit for Dialogue System Evaluation via Crowdsourcing

2021-05-05 · ACL 2021 5 · Yu Li, Josh Arnold, Feifan Yan, Weiyan Shi 외

We present LEGOEval, an open-source toolkit that enables researchers to easily evaluate dialogue systems in a few lines of code using the online crowdsource platform, Amazon Mechanical Turk. Compared to existing toolkits…

TreeSBA: Tree-Transformer for Self-Supervised Sequential Brick Assembly

2024-07-22 · Mengqi Guo, Chen Li, Yuyang Zhao, Gim Hee Lee

Inferring step-wise actions to assemble 3D objects with primitive bricks from images is a challenging task due to complex constraints and the vast number of possible combinations. Recent studies have demonstrated promisi…

3D AssemblyTransfer Learning

AttentionLego: An Open-Source Building Block For Spatially-Scalable Large Language Model Accelerator With Processing-In-Memory Technology

2024-01-21 · Rongqing Cong, Wenyang He, Mingxuan Li, Bangning Luo 외

Large language models (LLMs) with Transformer architectures have become phenomenal in natural language processing, multimodal generative artificial intelligence, and agent-oriented artificial intelligence. The self-atten…

Language ModelingLanguage ModellingLarge Language Model

Building LEGO Using Deep Generative Models of Graphs

2020-12-21 · Rylee Thompson, Elahe Ghalebi, Terrance DeVries, Graham W. Taylor

Generative models are now used to create a variety of high-quality digital artifacts. Yet their use in designing physical objects has received far less attention. In this paper, we advocate for the construction toy, LEGO…

Image2Lego: Customized LEGO Set Generation from Images

2021-08-19 · Kyle Lennon, Katharina Fransen, Alexander O'Brien, Yumeng Cao 외

Although LEGO sets have entertained generations of children and adults, the challenge of designing customized builds matching the complexity of real-world or imagined scenes remains too great for the average enthusiast. …