t-PINE: Tensor-based Predictable and Interpretable Node Embeddings
Graph representations have increasingly grown in popularity during the last years. Existing representation learning approaches explicitly encode network structure. Despite their good performance in downstream processes (e.g., node classification, link prediction), there is still room for improvement in different aspects, like efficacy, visualization, and interpretability. In this paper, we propose, t-PINE, a method that addresses these limitations. Contrary to baseline methods, which generally learn explicit graph representations by solely using an adjacency matrix, t-PINE avails a multi-view information graph, the adjacency matrix represents the first view, and a nearest neighbor adjacency, computed over the node features, is the second view, in order to learn explicit and implicit node representations, using the Canonical Polyadic (a.k.a. CP) decomposition. We argue that the implicit and the explicit mapping from a higher-dimensional to a lower-dimensional vector space is the key to learn more useful, highly predictable, and gracefully interpretable representations. Having good interpretable representations provides a good guidance to understand how each view contributes to the representation learning process. In addition, it helps us to exclude unrelated dimensions. Extensive experiments show that t-PINE drastically outperforms baseline methods by up to 158.6% with respect to Micro-F1, in several multi-label classification problems, while it has high visualization and interpretability utility.
Code (0)
등록된 구현이 없습니다.
Tasks
General ClassificationLink PredictionMulti-Label ClassificationMUlTI-LABEL-ClASSIFICATIONNode ClassificationRepresentation LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Vec2Node: Self-training with Tensor Augmentation for Text Classification with Few Labels
Recent advances in state-of-the-art machine learning models like deep neural networks heavily rely on large amounts of labeled training data which is difficult to obtain for many applications. To address label …
Data AugmentationTensor Decompositiontext-classificationText Classification+1An energy approach describes spine equilibrium in adolescent idiopathic scoliosis
The adolescent idiopathic scoliosis (AIS) is a 3D deformity of the spine whose origin is unknown and clinical evolution unpredictable. In this work, a mixed theoretical and numerical approach based on energetic considera…
GraphPINE: Graph Importance Propagation for Interpretable Drug Response Prediction
Explainability is necessary for many tasks in biomedical research. Recent explainability methods have focused on attention, gradient, and Shapley value. These do not handle data with strong associated prior knowledge and…
Drug Response PredictionGraph Neural NetworkPredictionSPINE: SParse Interpretable Neural Embeddings
Prediction without justification has limited utility. Much of the success of neural models can be attributed to their ability to learn rich, dense and expressive representations. While these representations capture the u…
DenoisingWord EmbeddingsEnsemble Node Embeddings using Tensor Decomposition: A Case-Study on DeepWalk
Node embeddings have been attracting increasing attention during the past years. In this context, we propose a new ensemble node embedding approach, called TenSemble2Vec, by first generating multiple embeddings using the…
Tensor Decomposition