paper-with-me

홈 › Papers

Attend, Adapt and Transfer: Attentive Deep Architecture for Adaptive Transfer from multiple sources in the same domain

2015-10-10 · Janarthanan Rajendran, Aravind Srinivas, Mitesh M. Khapra, P. Prasanna, Balaraman Ravindran

Transferring knowledge from prior source tasks in solving a new target task can be useful in several learning applications. The application of transfer poses two serious challenges which have not been adequately addressed. First, the agent should be able to avoid negative transfer, which happens when the transfer hampers or slows down the learning instead of helping it. Second, the agent should be able to selectively transfer, which is the ability to select and transfer from different and multiple source tasks for different parts of the state space of the target task. We propose A2T (Attend, Adapt and Transfer), an attentive deep architecture which adapts and transfers from these source tasks. Our model is generic enough to effect transfer of either policies or value functions. Empirical evaluations on different learning algorithms show that A2T is an effective architecture for transfer by being able to avoid negative transfer while transferring selectively from multiple source tasks in the same domain.

📄 PDF Abstract BibTeX arXiv:1510.02879

Code (2)

ancorso/DecomposedMDPSolver.jl
sisl/DecomposedMDPSolver.jl

Similar Papers 제목 키워드 기반

To miss-attend is to misalign! Residual Self-Attentive Feature Alignment for Adapting Object Detectors

2022-01-05 · WACV 2022 1 · Vaishnavi Khindkar, Chetan Arora, Vineeth N Balasubramanian, Anbumani Subramanian 외

Advancements in adaptive object detection can lead to tremendous improvements in applications like autonomous navigation, as they alleviate the distributional shifts along the detection pipeline. Prior works adopt advers…

Autonomous NavigationDiversityObjectobject-detection+2

Channel-Attentive Graph Neural Networks

2025-03-01 · Tuğrul Hasan Karabulut, İnci M. Baytaş

Graph Neural Networks (GNNs) set the state-of-the-art in representation learning for graph-structured data. They are used in many domains, from online social networks to complex molecules. Most GNNs leverage the message-…

Representation Learning

Partial Video Domain Adaptation with Partial Adversarial Temporal Attentive Network

2021-07-11 · ICCV 2021 10 · Yuecong Xu, Jianfei Yang, Haozhi Cao, Qi Li 외

Partial Domain Adaptation (PDA) is a practical and general domain adaptation scenario, which relaxes the fully shared label space assumption such that the source label space subsumes the target one. The key challenge of …

Domain AdaptationPartial Domain Adaptation

Scene-Adaptive Attention Network for Crowd Counting

2021-12-31 · Xing Wei, Yuanrui Kang, Jihao Yang, Yunfeng Qiu 외

In recent years, significant progress has been made on the research of crowd counting. However, as the challenging scale variations and complex scenes existed in crowds, neither traditional convolution networks nor recen…

Crowd Counting

Attending to Mathematical Language with Transformers

2018-12-05 · Artit Wangperawong

Mathematical expressions were generated, evaluated and used to train neural network models based on the transformer architecture. The expressions and their targets were analyzed as a character-level sequence transduction…

Decoder