Explaining Contextualization in Language Models using Visual Analytics
Despite the success of contextualized language models on various NLP tasks, it is still unclear what these models really learn. In this paper, we contribute to the current efforts of explaining such models by exploring the continuum between function and content words with respect to contextualization in BERT, based on linguistically-informed insights. In particular, we utilize scoring and visual analytics techniques: we use an existing similarity-based score to measure contextualization and integrate it into a novel visual analytics technique, presenting the model{'}s layers simultaneously and highlighting intra-layer properties and inter-layer differences. We show that contextualization is neither driven by polysemy nor by pure context variation. We also provide insights on why BERT fails to model words in the middle of the functionality continuum.
Code (0)
등록된 구현이 없습니다.
Methods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Visual Knowledge Discovery with Artificial Intelligence: Challenges and Future Directions
This volume is devoted to the emerging field of Integrated Visual Knowledge Discovery that combines advances in Artificial Intelligence/Machine Learning (AI/ML) and Visualization/Visual Analytics. Chapters included are e…
GeoExplainer: A Visual Analytics Framework for Spatial Modeling Contextualization and Report Generation
Geographic regression models of various descriptions are often applied to identify patterns and anomalies in the determinants of spatially distributed observations. These types of analyses focus on answering why question…
regressionText GenerationExplaining Vulnerabilities to Adversarial Machine Learning through Visual Analytics
Machine learning models are currently being deployed in a variety of real-world applications where model predictions are used to make decisions about healthcare, bank loans, and numerous other critical tasks. As the depl…
BIG-bench Machine LearningData PoisoningRacing Thoughts: Explaining Contextualization Errors in Large Language Models
The profound success of transformer-based language models can largely be attributed to their ability to integrate relevant contextual information from an input sequence in order to generate a response or complete a task.…
Language ModelingLanguage ModellingLarge Language ModelA Visual Analytics Framework for Explaining and Diagnosing Transfer Learning Processes
Many statistical learning models hold an assumption that the training data and the future unlabeled data are drawn from the same distribution. However, this assumption is difficult to fulfill in real-world scenarios and …
Deep LearningDescriptiveimage-classificationImage Classification+1