Finding Interpretable Concept Spaces in Node Embeddings using Knowledge Bases
In this paper we propose and study the novel problem of explaining node embeddings by finding embedded human interpretable subspaces in already trained unsupervised node representation embeddings. We use an external knowledge base that is organized as a taxonomy of human-understandable concepts over entities as a guide to identify subspaces in node embeddings learned from an entity graph derived from Wikipedia. We propose a method that given a concept finds a linear transformation to a subspace where the structure of the concept is retained. Our initial experiments show that we obtain low error in finding fine-grained concepts.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Node Role-Guided LLMs for Dynamic Graph Clustering
Dynamic graph clustering aims to detect and track time-varying clusters in dynamic graphs, revealing how complex real-world systems evolve over time. However, existing methods are predominantly black-box models. They lac…
Graph ClusteringExplainable Mapper: Charting LLM Embedding Spaces Using Perturbation-Based Explanation and Verification Agents
Large language models (LLMs) produce high-dimensional embeddings that capture rich semantic and syntactic relationships between words, sentences, and concepts. Investigating the topological structures of LLM embedding sp…
Decomposing Representation Space into Interpretable Subspaces with Unsupervised Learning
Understanding internal representations of neural models is a core interest of mechanistic interpretability. Due to its large dimensionality, the representation space can encode various aspects about inputs. To what exten…
Knowledge Representation with Conceptual Spaces
Entity embeddings are vector space representations of a given domain of interest. They are typically learned from text corpora (possibly in combination with any available structured knowledge), based on the intuition tha…
Entity EmbeddingsInformation RetrievalInterpretable Machine LearningRepresentation LearningDINE: Dimensional Interpretability of Node Embeddings
Graphs are ubiquitous due to their flexibility in representing social and technological systems as networks of interacting elements. Graph representation learning methods, such as node embeddings, are powerful approaches…
Graph Representation LearningLink PredictionRepresentation Learning