Concept Boundary Vectors
Machine learning models are trained with relatively simple objectives, such as next token prediction. However, on deployment, they appear to capture a more fundamental representation of their input data. It is of interest to understand the nature of these representations to help interpret the model's outputs and to identify ways to improve the salience of these representations. Concept vectors are constructions aimed at attributing concepts in the input data to directions, represented by vectors, in the model's latent space. In this work, we introduce concept boundary vectors as a concept vector construction derived from the boundary between the latent representations of concepts. Empirically we demonstrate that concept boundary vectors capture a concept's semantic meaning, and we compare their effectiveness against concept activation vectors.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Compact Shape Trees: A Contribution to the Forest of Shape Correspondences and Matching Methods
We propose a novel technique, termed compact shape trees, for computing correspondences of single-boundary 2-D shapes in O(n2) time. Together with zero or more features defined at each of n sample points on the shape's b…
Oriented Object Detection in Aerial Images with Box Boundary-Aware Vectors
Oriented object detection in aerial images is a challenging task as the objects in aerial images are displayed in arbitrary directions and are usually densely packed. Current oriented object detection methods mainly rely…
Objectobject-detectionObject DetectionObject Detection In Aerial Images+2Sentence Boundary Detection for French with Subword-Level Information Vectors and Convolutional Neural Networks
In this work we tackle the problem of sentence boundary detection applied to French as a binary classification task ("sentence boundary" or "not sentence boundary"). We combine convolutional neural networks with subword-…
Binary ClassificationBoundary DetectionSentenceExplaining Concept Drift through the Evolution of Group Counterfactuals
Machine learning models in dynamic environments often suffer from concept drift, where changes in the data distribution degrade performance. While detecting this drift is a well-studied topic, explaining how and why the …
Weighting vectors for machine learning: numerical harmonic analysis applied to boundary detection
Metric space magnitude, an active field of research in algebraic topology, is a scalar quantity that summarizes the effective number of distinct points that live in a general metric space. The {\em weighting vector} is a…
BIG-bench Machine LearningBoundary DetectionOutlier Detection