Accumulating Word Representations in Multi-level Context Integration for ERC Task
Emotion Recognition in Conversations (ERC) has attracted augmented interest recently because of its pronounced adaptability, which is to forecast the sentiment label for each utterance given a conversation as context. In order to identify the emotion of a focal sentence, it is crucial to model its meaning fused with contextual information. Many recent studies have focused on capturing different types of context as supporting information and integrated it in various ways: local and global contexts or at the speaker level through intra-speaker and inter-speaker integration. However, the importance of word representations after context integration has not been investigated completely, while word information is also essential to reflect the speaker's emotions in the conversation. Therefore, in this work, we endeavor to investigate the impact of accumulating word vector representations on sentence modeling fused with multi-level contextual integration. To this end, we propose an effective method for sentence modeling in ERC tasks and achieve competitive state-of-the-art results across four widely recognized bench-mark datasets: Iemocap, MELD, EmoryNLP, and DailyDialog. Our source code can be accessed via the following link: github.com/yingjie7/per_erc/tree/AccumWR.
Code (1)
Tasks
Emotion RecognitionEmotion Recognition in ConversationSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Assessing Polyseme Sense Similarity through Co-predication Acceptability and Contextualised Embedding Distance
Co-predication is one of the most frequently used linguistic tests to tell apart shifts in polysemic sense from changes in homonymic meaning. It is increasingly coming under criticism as evidence is accumulating that it …
Word EmbeddingsAssessing Social and Intersectional Biases in Contextualized Word Representations
Social bias in machine learning has drawn significant attention, with work ranging from demonstrations of bias in a multitude of applications, curating definitions of fairness for different contexts, to developing algori…
FairnessSentenceWord EmbeddingsImproving Matching Models with Hierarchical Contextualized Representations for Multi-turn Response Selection
In this paper, we study context-response matching with pre-trained contextualized representations for multi-turn response selection in retrieval-based chatbots. Existing models, such as Cove and ELMo, are trained with li…
DecoderDialogue GenerationRetrievalSentenceAccurate Word Representations with Universal Visual Guidance
Word representation is a fundamental component in neural language understanding models. Recently, pre-trained language models (PrLMs) offer a new performant method of contextualized word representations by leveraging the…
Machine TranslationNatural Language UnderstandingTranslationContextual and Non-Contextual Word Embeddings: an in-depth Linguistic Investigation
In this paper we present a comparison between the linguistic knowledge encoded in the internal representations of a contextual Language Model (BERT) and a contextual-independent one (Word2vec). We use a wide set of probi…
Language ModelingLanguage ModellingSentenceWord Embeddings