Enhancing Context Modeling with a Query-Guided Capsule Network for Document-level Translation
Context modeling is essential to generate coherent and consistent translation for Document-level Neural Machine Translations. The widely used method for document-level translation usually compresses the context information into a representation via hierarchical attention networks. However, this method neither considers the relationship between context words nor distinguishes the roles of context words. To address this problem, we propose a query-guided capsule networks to cluster context information into different perspectives from which the target translation may concern. Experiment results show that our method can significantly outperform strong baselines on multiple data sets of different domains.
Code (0)
등록된 구현이 없습니다.
Tasks
TranslationSimilar Papers 제목 키워드 기반
Dynamic Context-guided Capsule Network for Multimodal Machine Translation
Multimodal machine translation (MMT), which mainly focuses on enhancing text-only translation with visual features, has attracted considerable attention from both computer vision and natural language processing communiti…
DecoderMachine TranslationMultimodal Machine TranslationRepresentation Learning+1Dual-State Capsule Networks for Text Classification
Text classification systems based on contextual embeddings are not viable options for many of the low resource languages. On the other hand, recently introduced capsule networks have shown performance in par with these t…
ClassificationLanguage ModelingLanguage ModellingSentence+2Introducing Routing Uncertainty in Capsule Networks
Rather than performing inefficient local iterative routing between adjacent capsule layers, we propose an alternative global view based on representing the inherent uncertainty in part-object assignment. In our formulati…
ObjectVariational InferencePerceive, Query & Reason: Enhancing Video QA with Question-Guided Temporal Queries
Video Question Answering (Video QA) is a challenging video understanding task that requires models to comprehend entire videos, identify the most relevant information based on contextual cues from a given question, and r…
Question AnsweringVideo Question AnsweringVideo UnderstandingCapsuleGAN: Generative Adversarial Capsule Network
We present Generative Adversarial Capsule Network (CapsuleGAN), a framework that uses capsule networks (CapsNets) instead of the standard convolutional neural networks (CNNs) as discriminators within the generative adver…
General ClassificationGenerative Adversarial Networkimage-classificationImage Classification+1