Weight Space Representation Learning via Neural Field Adaptation
We investigate the potential of weights to serve as effective representations, focusing on neural fields. Our key insight is that constraining the optimization space through a pre-trained base model and low-rank adaptation (LoRA) can induce structure in weight space. Across reconstruction, generation, and analysis tasks on 2D and 3D data, we find that multiplicative LoRA weights achieve high representation quality while exhibiting distinctiveness and semantic structure. When used with latent diffusion models, multiplicative LoRA weights enable higher-quality generation than existing weight-space methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Representation LearningSimilar Papers 제목 키워드 기반
Learning Cardiac Motion Priors for Implicit Neural Representations
Implicit neural representations (INRs) are well suited to cardiac motion estimation, providing continuous, compact representations of motion fields. However, fitting an INR to each image sequence is time-consuming and se…
VeFA: Vector-Based Feature Space Adaptation for Robust Model Fine-Tuning
Catastrophic forgetting is a well-documented challenge in model fine-tuning, particularly when the downstream domain has limited labeled data or differs substantially from the pre-training distribution. Existing paramete…
parameter-efficient fine-tuningImage ClassificationT-VSS: Test-Time Visual Subspace Steering for Adversarial Robustness of Vision-Language Models
Vision-language models (VLMs) achieve strong zero-shot recognition, but they remain highly vulnerable to adversarial perturbations. Recent test-time adaptations improve robustness without retraining, but they do not dire…
Adversarial RobustnessTest-time AdaptationDEAAN: Disentangled Embedding and Adversarial Adaptation Network for Robust Speaker Representation Learning
Despite speaker verification has achieved significant performance improvement with the development of deep neural networks, domain mismatch is still a challenging problem in this field. In this study, we propose a novel …
DisentanglementDomain AdaptationRepresentation LearningSpeaker VerificationSelf-Routed Tensor Adapters for Parameter-Efficient Universal Visual Adaptation
Universal visual representations require adaptation mechanisms that adapt across heterogeneous domains without fragmenting knowledge into domain-specific modules. Parameter-efficient fine-tuning adapts frozen visual foun…
parameter-efficient fine-tuning