paper-with-me

Papers

Coreference Resolution through a seq2seq Transition-Based System

2022-11-22 · Bernd Bohnet, Chris Alberti, Michael Collins

Most recent coreference resolution systems use search algorithms over possible spans to identify mentions and resolve coreference. We instead present a coreference resolution system that uses a text-to-text (seq2seq) paradigm to predict mentions and links jointly. We implement the coreference system as a transition system and use multilingual T5 as an underlying language model. We obtain state-of-the-art accuracy on the CoNLL-2012 datasets with 83.3 F1-score for English (a 2.3 higher F1-score than previous work (Dobrovolskii, 2021)) using only CoNLL data for training, 68.5 F1-score for Arabic (+4.1 higher than previous work) and 74.3 F1-score for Chinese (+5.3). In addition we use the SemEval-2010 data sets for experiments in the zero-shot setting, a few-shot setting, and supervised setting using all available training data. We get substantially higher zero-shot F1-scores for 3 out of 4 languages than previous approaches and significantly exceed previous supervised state-of-the-art results for all five tested languages.

📄 PDF Abstract BibTeX arXiv:2211.12142

Code (1)

google-research/google-research 공식 구현 tf

Tasks

coreference-resolutionCoreference ResolutionLanguage ModelingLanguage Modelling

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Adafactor Adafactor is a stochastic optimization method based on Adam that reduces memory usage while retaining the empirical benefits of…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Residual Connection 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

Improving Event Coreference Resolution by Modeling Correlations between Event Coreference Chains and Document Topic Structures

2018-07-01 · ACL 2018 7 · Prafulla Kumar Choubey, Ruihong Huang

This paper proposes a novel approach for event coreference resolution that models correlations between event coreference chains and document topical structures through an Integer Linear Programming formulation. We explic…

coreference-resolutionCoreference ResolutionEvent Coreference ResolutionQuestion Answering

Incorporating Centering Theory into Neural Coreference Resolution

2022-07-01 · NAACL 2022 7 · Haixia Chai, Michael Strube

In recent years, transformer-based coreference resolution systems have achieved remarkable improvements on the CoNLL dataset. However, how coreference resolvers can benefit from discourse coherence is still an open quest…

coreference-resolutionCoreference ResolutionOpen-Ended Question Answering

Towards Harnessing Memory Networks for Coreference Resolution

2017-08-01 · WS 2017 8 · Joe Cheri, Pushpak Bhattacharyya

Coreference resolution task demands comprehending a discourse, especially for anaphoric mentions which require semantic information for resolving antecedents. We investigate into how memory networks can be helpful for co…

coreference-resolutionCoreference ResolutionQuestion AnsweringRepresentation Learning

Sieve-based Coreference Resolution in the Biomedical Domain

2016-03-11 · LREC 2016 5 · Dane Bell, Gus Hahn-Powell, Marco A. Valenzuela-Escárcega, Mihai Surdeanu

We describe challenges and advantages unique to coreference resolution in the biomedical domain, and a sieve-based architecture that leverages domain knowledge for both entity and event coreference resolution. Domain-gen…

coreference-resolutionCoreference ResolutionEvent Coreference ResolutionEvent Extraction

Toward Gender-Inclusive Coreference Resolution: An Analysis of Gender and Bias Throughout the Machine Learning Lifecycle*

2021-11-01 · CL (ACL) 2021 11 · Yang Trista Cao, Hal Daumé III

Abstract Correctly resolving textual mentions of people fundamentally entails making inferences about those people. Such inferences raise the risk of systematic biases in coreference resolution systems, including biases …

coreference-resolutionCoreference ResolutionSociology