What Knowledge Is Needed? Towards Explainable Memory for kNN-MT Domain Adaptation
kNN-MT presents a new paradigm for domain adaptation by building an external datastore, which usually saves all target language token occurrences in the parallel corpus. As a result, the constructed datastore is usually large and possibly redundant. In this paper, we investigate the interpretability issue of this approach: what knowledge does the NMT model need? We propose the notion of local correctness (LAC) as a new angle, which describes the potential translation correctness for a single entry and for a given neighborhood. Empirical study shows that our investigation successfully finds the conditions where the NMT model could easily fail and need related knowledge. Experiments on six diverse target domains and two language-pairs show that pruning according to local correctness brings a light and more explainable memory for kNN-MT domain adaptation.
Code (1)
Tasks
Domain AdaptationNMTTranslationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Foundations of Explainable Knowledge-Enabled Systems
Explainability has been an important goal since the early days of Artificial Intelligence. Several approaches for producing explanations have been developed. However, many of these approaches were tightly coupled with th…
Explainable artificial intelligenceExplainable Machine Learning for Scientific Insights and Discoveries
Machine learning methods have been remarkably successful for a wide range of application areas in the extraction of essential information from data. An exciting and relatively recent development is the uptake of machine …
BIG-bench Machine LearningCIP-Net: Continual Interpretable Prototype-based Network
Continual learning constrains models to learn new tasks over time without forgetting what they have already learned. A key challenge in this setting is catastrophic forgetting, where learning new information causes the m…
Continual LearningE-GPS: Explainable Geometry Problem Solving via Top-Down Solver and Bottom-Up Generator
Geometry Problem Solving has drawn growing attention recently due to its application prospects in intelligent education field. However existing methods are still inadequate to meet the needs of practical application …
Geometry Problem SolvingScience Literacy: Generative AI as Enabler of Coherence in the Teaching, Learning, and Assessment of Scientific Knowledge and Reasoning
This chapter examines the potential of generative AI in enhancing science literacy across the K-16+ grade span, including its benefits as well as the conceptual and practical challenges that doing so presents. It begins …