paper-with-me

홈 › Papers

Neural Relation Graph: A Unified Framework for Identifying Label Noise and Outlier Data

2023-01-29 · NeurIPS 2023 11 · Jang-Hyun Kim, Sangdoo Yun, Hyun Oh Song

Diagnosing and cleaning data is a crucial step for building robust machine learning systems. However, identifying problems within large-scale datasets with real-world distributions is challenging due to the presence of complex issues such as label errors, under-representation, and outliers. In this paper, we propose a unified approach for identifying the problematic data by utilizing a largely ignored source of information: a relational structure of data in the feature-embedded space. To this end, we present scalable and effective algorithms for detecting label errors and outlier data based on the relational graph structure of data. We further introduce a visualization tool that provides contextual information of a data point in the feature-embedded space, serving as an effective tool for interactively diagnosing data. We evaluate the label error and outlier/out-of-distribution (OOD) detection performances of our approach on the large-scale image, speech, and language domain tasks, including ImageNet, ESC-50, and SST2. Our approach achieves state-of-the-art detection performance on all tasks considered and demonstrates its effectiveness in debugging large-scale real-world datasets across various domains. We release codes at https://github.com/snu-mllab/Neural-Relation-Graph.

📄 PDF Abstract BibTeX arXiv:2301.12321

Code (1)

snu-mllab/neural-relation-graph 공식 구현 pytorch

Tasks

Out of Distribution (OOD) DetectionRelation

Similar Papers 제목 키워드 기반

A Two-Stage Parsing Method for Text-Level Discourse Analysis

2017-07-01 · ACL 2017 7 · Yizhong Wang, Sujian Li, Houfeng Wang

Previous work introduced transition-based algorithms to form a unified architecture of parsing rhetorical structures (including span, nuclearity and relation), but did not achieve satisfactory performance. In this paper,…

Dependency ParsingDocument SummarizationRelationSentence+2

Learning Causal Transition Matrix for Instance-dependent Label Noise

2024-12-18 · Jiahui Li, Tai-Wei Chang, Kun Kuang, Ximing Li 외

Noisy labels are both inevitable and problematic in machine learning methods, as they negatively impact models' generalization ability by causing overfitting. In the context of learning with noise, the transition matrix …

Multi-Task Identification of Entities, Relations, and Coreference for Scientific Knowledge Graph Construction

2018-08-29 · EMNLP 2018 10 · Yi Luan, Luheng He, Mari Ostendorf, Hannaneh Hajishirzi

We introduce a multi-task setup of identifying and classifying entities, relations, and coreference clusters in scientific articles. We create SciERC, a dataset that includes annotations for all three tasks and develop a…

ArticlesCoreference ResolutionJoint Entity and Relation ExtractionNamed Entity Recognition (NER)+1

A Unified Architecture for Semantic Role Labeling and Relation Classification

2016-12-01 · COLING 2016 12 · Jiang Guo, Wanxiang Che, Haifeng Wang, Ting Liu 외

This paper describes a unified neural architecture for identifying and classifying multi-typed semantic relations between words in a sentence. We investigate two typical and well-studied tasks: semantic role labeling (SR…

ClassificationFeature EngineeringGeneral ClassificationInformation Retrieval+7

Self-organization Preserved Graph Structure Learning with Principle of Relevant Information

2022-12-30 · Qingyun Sun, JianXin Li, Beining Yang, Xingcheng Fu 외

Most Graph Neural Networks follow the message-passing paradigm, assuming the observed structure depicts the ground-truth node relationships. However, this fundamental assumption cannot always be satisfied, as real-world …

Graph structure learning