paper-with-me

홈 › Papers

Domain Adaptation via Low-Rank Basis Approximation

2019-09-25 · Christoph Raab, Frank-Michael Schleif

Domain adaptation focuses on the reuse of supervised learning models in a new context. Prominent applications can be found in robotics, image processing or web mining. In these areas, learning scenarios change by nature, but often remain related and motivate the reuse of existing supervised models. While the majority of symmetric and asymmetric domain adaptation algorithms utilize all available source and target domain data, we show that efficient domain adaptation requires only a substantially smaller subset from both domains. This makes it more suitable for real-world scenarios where target domain data is rare. The presented approach finds a target subspace representation for source and target data to address domain differences by orthogonal basis transfer. By employing a low-rank approximation, the approach remains low in computational time. The presented idea is evaluated in typical domain adaptation tasks with standard benchmark data.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Domain Adaptation

Similar Papers 제목 키워드 기반

Dynamic Subspace Composition: Efficient Adaptation via Contractive Basis Expansion

2025-12-29 · Vladimer Khasia arxiv

Mixture of Experts (MoE) models scale capacity but often suffer from representation collapse and gradient instability. We propose Dynamic Subspace Composition (DSC), a framework that approximates context-dependent weight…

Block Basis Factorization for Scalable Kernel Matrix Evaluation

2015-05-03 · Ruoxi Wang, Yingzhou Li, Michael W. Mahoney, Eric Darve

Kernel methods are widespread in machine learning; however, they are limited by the quadratic complexity of the construction, application, and storage of kernel matrices. Low-rank matrix approximation algorithms are wide…

BIG-bench Machine Learning

Mitigating Forgetting in Low Rank Adaptation

2025-12-19 · Joanna Sliwa, Frank Schneider, Philipp Hennig, Jose Miguel Hernandez-Lobato arxiv

Parameter-efficient fine-tuning methods, such as Low-Rank Adaptation (LoRA), enable fast specialization of large pre-trained models to different downstream applications. However, this process often leads to catastrophic …

parameter-efficient fine-tuningMathematical Reasoning

Ego-VPA: Egocentric Video Understanding with Parameter-efficient Adaptation

2024-07-28 · Tz-Ying Wu, Kyle Min, Subarna Tripathi, Nuno Vasconcelos

Video understanding typically requires fine-tuning the large backbone when adapting to new domains. In this paper, we leverage the egocentric video foundation models (Ego-VFMs) based on video-language pre-training and pr…

Video Understanding

Neural Approximation and Its Applications

2026-03-04 · Wei-Hao Wu, Ting-Zhu Huang, Xi-Le Zhao, Yisi Luo 외 arxiv

Multivariate function approximation is a fundamental problem in machine learning. Classic multivariate function approximations rely on hand-crafted basis functions (e.g., polynomial basis and Fourier basis), which limits…