paper-with-me

홈 › Papers

Word Grounded Graph Convolutional Network

2023-05-10 · Zhibin Lu, Qianqian Xie, Benyou Wang, Jian-Yun Nie

Graph Convolutional Networks (GCNs) have shown strong performance in learning text representations for various tasks such as text classification, due to its expressive power in modeling graph structure data (e.g., a literature citation network). Most existing GCNs are limited to deal with documents included in a pre-defined graph, i.e., it cannot be generalized to out-of-graph documents. To address this issue, we propose to transform the document graph into a word graph, to decouple data samples (i.e., documents in training and test sets) and a GCN model by using a document-independent graph. Such word-level GCN could therefore naturally inference out-of-graph documents in an inductive way. The proposed Word-level Graph (WGraph) can not only implicitly learning word presentation with commonly-used word co-occurrences in corpora, but also incorporate extra global semantic dependency derived from inter-document relationships (e.g., literature citations). An inductive Word-grounded Graph Convolutional Network (WGCN) is proposed to learn word and document representations based on WGraph in a supervised manner. Experiments on text classification with and without citation networks evidence that the proposed WGCN model outperforms existing methods in terms of effectiveness and efficiency.

📄 PDF Abstract BibTeX arXiv:2305.06434

Code (1)

Louis-udm/Word-Grounded-Graph-Convolutional-Network 공식 구현 pytorch

Tasks

text-classificationText Classification

Methods 이 논문이 사용한 방법론

Test 설명 없음
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

Similar Papers 제목 키워드 기반

Out-of-Vocabulary Embedding Imputation with Grounded Language Information by Graph Convolutional Networks

2019-06-10 · ACL 2019 7 · Ziyi Yang, Chenguang Zhu, Vin Sachidananda, Eric Darve

Due to the ubiquitous use of embeddings as input representations for a wide range of natural language tasks, imputation of embeddings for rare and unseen words is a critical problem in language processing. Embedding impu…

Imputation

Graph Neural Networks for Contextual ASR with the Tree-Constrained Pointer Generator

2023-05-30 · Guangzhi Sun, Chao Zhang, Phil Woodland

The incorporation of biasing words obtained through contextual knowledge is of paramount importance in automatic speech recognition (ASR) applications. This paper proposes an innovative method for achieving end-to-end co…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Graph Neural Networkspeech-recognition+1

Resolving References to Objects in Photographs using the Words-As-Classifiers Model

2015-10-07 · ACL 2016 8 · David Schlangen, Sina Zarriess, Casey Kennington

A common use of language is to refer to visually present objects. Modelling it in computers requires modelling the link between language and perception. The "words as classifiers" model of grounded semantics views words …

Learning grounded word meaning representations on similarity graphs

2021-09-07 · EMNLP 2021 11 · Mariella Dimiccoli, Herwig Wendt, Pau Batlle

This paper introduces a novel approach to learn visually grounded meaning representations of words as low-dimensional node embeddings on an underlying graph hierarchy. The lower level of the hierarchy models modality-spe…

Graph Embedding

Attention-Based Keyword Localisation in Speech using Visual Grounding

2021-06-16 · Kayode Olaleye, Herman Kamper

Visually grounded speech models learn from images paired with spoken captions. By tagging images with soft text labels using a trained visual classifier with a fixed vocabulary, previous work has shown that it is possibl…

Visual Grounding