End-to-end Deep Reinforcement Learning Based Coreference Resolution
Recent neural network models have significantly advanced the task of coreference resolution. However, current neural coreference models are usually trained with heuristic loss functions that are computed over a sequence of local decisions. In this paper, we introduce an end-to-end reinforcement learning based coreference resolution model to directly optimize coreference evaluation metrics. Specifically, we modify the state-of-the-art higher-order mention ranking approach in Lee et al. (2018) to a reinforced policy gradient model by incorporating the reward associated with a sequence of coreference linking actions. Furthermore, we introduce maximum entropy regularization for adequate exploration to prevent the model from prematurely converging to a bad local optimum. Our proposed model achieves new state-of-the-art performance on the English OntoNotes v5.0 benchmark.
Code (0)
등록된 구현이 없습니다.
Tasks
coreference-resolutionCoreference ResolutionDeep Reinforcement Learningreinforcement-learningReinforcement LearningReinforcement Learning (RL)Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Neural Coreference Resolution based on Reinforcement Learning
The target of a coreference resolution system is to cluster all mentions that refer to the same entity in a given context. All coreference resolution systems need to solve two subtasks; one task is to detect all of the p…
AllClusteringcoreference-resolutionCoreference Resolution+4End-to-end Neural Coreference Resolution Revisited: A Simple yet Effective Baseline
Since the first end-to-end neural coreference resolution model was introduced, many extensions to the model have been proposed, ranging from using higher-order inference to directly optimizing evaluation metrics using re…
coreference-resolutionCoreference ResolutionDeep Reinforcement Learning for Mention-Ranking Coreference Models
Coreference resolution systems are typically trained with heuristic loss functions that require careful tuning. In this paper we instead apply reinforcement learning to directly optimize a neural mention-ranking model fo…
coreference-resolutionCoreference ResolutionDeep Reinforcement Learningreinforcement-learning+2Towards Harnessing Memory Networks for Coreference Resolution
Coreference resolution task demands comprehending a discourse, especially for anaphoric mentions which require semantic information for resolving antecedents. We investigate into how memory networks can be helpful for co…
coreference-resolutionCoreference ResolutionQuestion AnsweringRepresentation LearningCross-document Coreference Resolution over Predicted Mentions
Coreference resolution has been mostly investigated within a single document scope, showing impressive progress in recent years based on end-to-end models. However, the more challenging task of cross-document (CD) corefe…
coreference-resolutionCoreference ResolutionCross Document Coreference Resolution