Exploiting Network Structures to Improve Semantic Representation for the Financial Domain
This paper presents the participation of the MiniTrue team in the FinSim-3 shared task on learning semantic similarities for the financial domain in English language. Our approach combines contextual embeddings learned by transformer-based language models with network structures embeddings extracted on external knowledge sources, to create more meaningful representations of financial domain entities and terms. For this, two BERT based language models and a knowledge graph embedding model are used. Besides, we propose a voting function to joint three basic models for the final inference. Experimental results show that the model with the knowledge graph embeddings has achieved a superior result than these models with only contextual embeddings. Nevertheless, we also observe that our voting function brings an extra benefit to the final system.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph EmbeddingKnowledge Graph EmbeddingKnowledge Graph EmbeddingsMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Enhancing Efficiency of Local Projections Estimation with Volatility Clustering in High-Frequency Data
This paper advances the local projections (LP) method by addressing its inefficiency in high-frequency economic and financial data with volatility clustering. We incorporate a generalized autoregressive conditional heter…
ClusteringExploiting Word Internal Structures for Generic Chinese Sentence Representation
We introduce a novel mixed characterword architecture to improve Chinese sentence representations, by utilizing rich semantic information of word internal structures. Our architecture uses two key strategies. The first i…
SentenceSentence SimilarityInteroperable Semantic Annotation
The paper presents an annotation schema with the following characteristics: it is formally compact; it systematically and compositionally expands into fullfledged analytic representations, exploiting simple algorithms of…
Learning Concept Embeddings for Efficient Bag-of-Concepts Densification
Explicit concept space models have proven efficacy for text representation in many natural language and text mining applications. The idea is to embed textual structures into a semantic space of concepts which captures t…
Document ClassificationSemi-Supervised Domain Adaptation for Weakly Labeled Semantic Video Object Segmentation
Deep convolutional neural networks (CNNs) have been immensely successful in many high-level computer vision tasks given large labeled datasets. However, for video semantic object segmentation, a domain where labels are s…
Domain AdaptationSegmentationSemantic SegmentationSemi-supervised Domain Adaptation+3