paper-with-me

Papers

Cross-Model Semantics in Representation Learning

2025-08-05 · Saleh Nikooroo, Thomas Engel arxiv

The internal representations learned by deep networks are often sensitive to architecture-specific choices, raising questions about the stability, alignment, and transferability of learned structure across models. In this paper, we investigate how structural constraints--such as linear shaping operators and corrective paths--affect the compatibility of internal representations across different architectures. Building on the insights from prior studies on structured transformations and convergence, we develop a framework for measuring and analyzing representational alignment across networks with distinct but related architectural priors. Through a combination of theoretical insights, empirical probes, and controlled transfer experiments, we demonstrate that structural regularities induce representational geometry that is more stable under architectural variation. This suggests that certain forms of inductive bias not only support generalization within a model, but also improve the interoperability of learned features across models. We conclude with a discussion on the implications of representational transferability for model distillation, modular learning, and the principled design of robust learning systems.

📄 PDF Abstract BibTeX arXiv:2508.03649

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

Embedding and Enriching Explicit Semantics for Visible-Infrared Person Re-Identification

2024-12-11 · Neng Dong, Shuanglin Yan, Liyan Zhang, Jinhui Tang

Visible-infrared person re-identification (VIReID) retrieves pedestrian images with the same identity across different modalities. Existing methods learn visual content solely from images, lacking the capability to sense…

Person Re-Identification

SemVLP: Vision-Language Pre-training by Aligning Semantics at Multiple Levels

2021-03-14 · Chenliang Li, Ming Yan, Haiyang Xu, Fuli Luo 외

Vision-language pre-training (VLP) on large-scale image-text pairs has recently witnessed rapid progress for learning cross-modal representations. Existing pre-training methods either directly concatenate image represent…

Learning Program Semantics with Code Representations: An Empirical Study

2022-03-22 · Jing Kai Siow, Shangqing Liu, Xiaofei Xie, Guozhu Meng 외

Program semantics learning is the core and fundamental for various code intelligent tasks e.g., vulnerability detection, clone detection. A considerable amount of existing works propose diverse approaches to learn the pr…

Clone DetectionCode ClassificationVulnerability Detection

Focus-to-Perceive Representation Learning: A Cognition-Inspired Hierarchical Framework for Endoscopic Video Analysis

2026-03-26 · Yuan Zhang, Sihao Dou, Kai Hu, Shuhua Deng 외 arxiv

Endoscopic video analysis is essential for early gastrointestinal screening but remains hindered by limited high-quality annotations. While self-supervised video pre-training shows promise, existing methods developed for…

Representation Learning

Self-Supervised Video Representation Learning in a Heuristic Decoupled Perspective

2024-07-19 · Zeen Song, Jingyao Wang, Jianqi Zhang, Changwen Zheng 외

Video contrastive learning (v-CL) has gained prominence as a leading framework for unsupervised video representation learning, showcasing impressive performance across various tasks such as action classification and dete…

Action ClassificationContrastive LearningRepresentation Learning