Analyzing Text Representations by Measuring Task Alignment
Textual representations based on pre-trained language models are key, especially in few-shot learning scenarios. What makes a representation good for text classification? Is it due to the geometric properties of the space or because it is well aligned with the task? We hypothesize the second claim. To test it, we develop a task alignment score based on hierarchical clustering that measures alignment at different levels of granularity. Our experiments on text classification validate our hypothesis by showing that task alignment can explain the classification performance of a given representation.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationClusteringFew-Shot Learningtext-classificationText ClassificationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Analyzing Text Representations under Tight Annotation Budgets: Measuring Structural Alignment
Annotating large collections of textual data can be time consuming and expensive. That is why the ability to train models with limited annotation budgets is of great importance. In this context, it has been shown that un…
text-classificationText ClassificationLAViTeR: Learning Aligned Visual and Textual Representations Assisted by Image and Caption Generation
Pre-training visual and textual representations from large-scale image-text pairs is becoming a standard approach for many downstream vision-language tasks. The transformer-based models learn inter and intra-modal attent…
Caption GenerationImage CaptioningImage GenerationRepresentation Learning+1Characterizing the Influence of Topology on Graph Learning Tasks
Graph neural networks (GNN) have achieved remarkable success in a wide range of tasks by encoding features combined with topology to create effective representations. However, the fundamental problem of understanding and…
Graph LearningStochastic Block ModelALAS: Measuring Latent Speech-Text Alignment For Spoken Language Understanding In Multimodal LLMs
Large Language Models (LLMs) are widely used in Spoken Language Understanding (SLU). Recent SLU models process audio directly by adapting speech input into LLMs for better multimodal learning. A key consideration for the…
cross-modal alignmentEmotion RecognitionQuestion AnsweringSpoken Language UnderstandingCross-Model Semantics in Representation Learning
The internal representations learned by deep networks are often sensitive to architecture-specific choices, raising questions about the stability, alignment, and transferability of learned structure across models. In thi…
Representation Learning