paper-with-me

홈 › Papers

Global Safe Sequential Learning via Efficient Knowledge Transfer

2024-02-22 · Cen-You Li, Olaf Duennbier, Marc Toussaint, Barbara Rakitsch, Christoph Zimmer

Sequential learning methods, such as active learning and Bayesian optimization, aim to select the most informative data for task learning. In many applications, however, data selection is constrained by unknown safety conditions, motivating the development of safe learning approaches. A promising line of safe learning methods uses Gaussian processes to model safety conditions, restricting data selection to areas with high safety confidence. However, these methods are limited to local exploration around an initial seed dataset, as safety confidence centers around observed data points. As a consequence, task exploration is slowed down and safe regions disconnected from the initial seed dataset remain unexplored. In this paper, we propose safe transfer sequential learning to accelerate task learning and to expand the explorable safe region. By leveraging abundant offline data from a related source task, our approach guides exploration in the target task more effectively. We also provide a theoretical analysis to explain why single-task method cannot cope with disconnected regions. Finally, we introduce a computationally efficient approximation of our method that reduces runtime through pre-computations. Our experiments demonstrate that this approach, compared to state-of-the-art methods, learns tasks with lower data consumption and enhances global exploration across multiple disjoint safe regions, while maintaining comparable computational efficiency.

📄 PDF Abstract BibTeX arXiv:2402.14402

Code (2)

boschresearch/transfersafesequentiallearning 공식 구현 pytorch
cenyou/transfersafesequentiallearning 공식 구현 pytorch

Tasks

Active LearningBayesian OptimizationComputational EfficiencyGaussian ProcessesTransfer Learning

Similar Papers 제목 키워드 기반

Improving Sequential Recommendation Consistency with Self-Supervised Imitation

2021-06-26 · Xu Yuan, Hongshen Chen, Yonghao Song, Xiaofang Zhao 외

Most sequential recommendation models capture the features of consecutive items in a user-item interaction history. Though effective, their representation expressiveness is still hindered by the sparse learning signals. …

Imitation LearningSequential RecommendationSparse Learning

Bridging the Multilingual Safety Divide: Efficient, Culturally-Aware Alignment for Global South Languages

2026-02-14 · Somnath Banerjee, Rima Hazra, Animesh Mukherjee arxiv

Large language models (LLMs) are being deployed across the Global South, where everyday use involves low-resource languages, code-mixing, and culturally specific norms. Yet safety pipelines, benchmarks, and alignment sti…

Multilingual Refusal Alignment for Safer Large Language Models

2026-04-24 · Aleksandra Krasnodębska, Wojciech Kusa, Aldo Lipani arxiv

As Large Language Models (LLMs) are deployed globally, ensuring their safety and alignment across multiple languages becomes paramount. However, safety behaviors often vary unpredictably between languages, posing signifi…

General Knowledge

AdapNet: Adaptability Decomposing Encoder-Decoder Network for Weakly Supervised Action Recognition and Localization

2019-11-27 · Xiao-Yu Zhang, Changsheng Li, Haichao Shi, Xiaobin Zhu 외

The point process is a solid framework to model sequential data, such as videos, by exploring the underlying relevance. As a challenging problem for high-level video understanding, weakly supervised action recognition an…

Action ClassificationAction RecognitionDecoderTemporal Localization+3

Recurrent Knowledge Identification and Fusion for Language Model Continual Learning

2025-02-22 · Yujie Feng, Xujia Wang, Zexin Lu, Shenghong Fu 외

Continual learning (CL) is crucial for deploying large language models (LLMs) in dynamic real-world environments without costly retraining. While recent model ensemble and model merging methods guided by parameter import…

Continual LearningLanguage ModelingLanguage ModellingTransfer Learning