paper-with-me

홈 › Papers

Building Shortcuts between Distant Nodes with Biaffine Mapping for Graph Convolutional Networks

2023-02-17 · Acong Zhang, Jincheng Huang, Ping Li, Kai Zhang

Multiple recent studies show a paradox in graph convolutional networks (GCNs), that is, shallow architectures limit the capability of learning information from high-order neighbors, while deep architectures suffer from over-smoothing or over-squashing. To enjoy the simplicity of shallow architectures and overcome their limits of neighborhood extension, in this work, we introduce Biaffine technique to improve the expressiveness of graph convolutional networks with a shallow architecture. The core design of our method is to learn direct dependency on long-distance neighbors for nodes, with which only one-hop message passing is capable of capturing rich information for node representation. Besides, we propose a multi-view contrastive learning method to exploit the representations learned from long-distance dependencies. Extensive experiments on nine graph benchmark datasets suggest that the shallow biaffine graph convolutional networks (BAGCN) significantly outperforms state-of-the-art GCNs (with deep or shallow architectures) on semi-supervised node classification. We further verify the effectiveness of biaffine design in node representation learning and the performance consistency on different sizes of training data.

📄 PDF Abstract BibTeX arXiv:2302.08727

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningNode ClassificationRepresentation Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Hitachi at MRP 2019: Unified Encoder-to-Biaffine Network for Cross-Framework Meaning Representation Parsing

2019-10-03 · CONLL 2019 11 · Yuta Koreeda, Gaku Morio, Terufumi Morishita, Hiroaki Ozaki 외

This paper describes the proposed system of the Hitachi team for the Cross-Framework Meaning Representation Parsing (MRP 2019) shared task. In this shared task, the participating systems were asked to predict nodes, edge…

DecoderMulti-Task Learning

Biaffine Discourse Dependency Parsing

2022-01-12 · Yingxue Fu

We provide a study of using the biaffine model for neural discourse dependency parsing and achieve significant performance improvement compared with the baseline parsers. We compare the Eisner algorithm and the Chu-Liu-E…

Dependency Parsing

Biaffine Discourse Dependency Parsing

2021-11-16 · ACL ARR November 2021 11 · Anonymous

We provide the first study of using the biaffine model for neural discourse dependency parsing and achieve significant performance improvement compared with the baseline parsers. We compare the Eisner algorithm and the C…

Dependency Parsing

JBNU at MRP 2019: Multi-level Biaffine Attention for Semantic Dependency Parsing

2019-11-01 · CONLL 2019 11 · Seung-Hoon Na, Jinwoon Min, Kwanghyeon Park, Jong-Hun Shin 외

This paper describes Jeonbuk National University (JBNU){'}s system for the 2019 shared task on Cross-Framework Meaning Representation Parsing (MRP 2019) at the Conference on Computational Natural Language Learning. Of th…

DecoderDependency ParsingSemantic Dependency ParsingSentence

Multi-layer Biaffine Model for Neural Dependency Parsing

2021-11-16 · ACL ARR November 2021 11 · Anonymous

The biaffine model is a strong and efficient model for graph-based dependency parsing. However, previous work only used the biaffine method in single-layer form. In this paper, we propose a multi-layer biaffine model for…

Dependency ParsingForm