Similarity-based representation factorization for revealing interpretable dimensions in representational data
The study of representations is widespread across fields, including neuroscience, psychology, and artificial intelligence. While representations are often studied and compared through similarities between stimuli, current methods provide only limited access to the dimensions that shape these representations and are often limited in interpretability. To overcome these challenges, here we introduce Similarity-Based Representation Factorization (SRF), a general computational method for recovering low-dimensional, non-negative, interpretable embeddings from similarity matrices derived from measured data. Across simulations and many neural, behavioral, and computational datasets, SRF recovers interpretable dimensions from diverse forms of representational data, even for very sparsely sampled, incomplete data. The dimensions derived from these datasets match those obtained by task-specific models, predict independent behavioral properties, improve exploratory analysis, and offer higher power for confirmatory hypothesis testing than comparing similarity matrices. Together, these results establish SRF as a general-purpose method with broad applications for uncovering, understanding, and using the dimensions underlying representations.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Revealing interpretable object representations from human behavior
To study how mental object representations are related to behavior, we estimated sparse, non-negative representations of objects using human behavioral judgments on images representative of 1,854 object categories. These…
ObjectIntermediate Entity-based Sparse Interpretable Representation Learning
Interpretable entity representations (IERs) are sparse embeddings that are "human-readable" in that dimensions correspond to fine-grained entity types and values are predicted probabilities that a given entity is of the …
counterfactualRepresentation LearningPRISM: A Framework for Producing Interpretable Political Bias Embeddings with Political-Aware Cross-Encoder
Semantic Text Embedding is a fundamental NLP task that encodes textual content into vector representations, where proximity in the embedding space reflects semantic similarity. While existing embedding models excel at ca…
ArticlesSemantic SimilaritySemantic Textual SimilarityClosed-Form Factorization of Latent Semantics in GANs
A rich set of interpretable dimensions has been shown to emerge in the latent space of the Generative Adversarial Networks (GANs) trained for synthesizing images. In order to identify such latent dimensions for image edi…
AttributeFormImage GenerationImage ManipulationSurpassing Cosine Similarity for Multidimensional Comparisons: Dimension Insensitive Euclidean Metric
Advances in computational power and hardware efficiency have enabled tackling increasingly complex, high-dimensional problems. While artificial intelligence (AI) achieves remarkable results, the interpretability of high-…
Large Language ModelRecommendation Systems