paper-with-me

Papers

Dynamic Contrastive Skill Learning with State-Transition Based Skill Clustering and Dynamic Length Adjustment

2025-04-21 · Jinwoo Choi, Seung-Woo Seo

Reinforcement learning (RL) has made significant progress in various domains, but scaling it to long-horizon tasks with complex decision-making remains challenging. Skill learning attempts to address this by abstracting actions into higher-level behaviors. However, current approaches often fail to recognize semantically similar behaviors as the same skill and use fixed skill lengths, limiting flexibility and generalization. To address this, we propose Dynamic Contrastive Skill Learning (DCSL), a novel framework that redefines skill representation and learning. DCSL introduces three key ideas: state-transition based skill representation, skill similarity function learning, and dynamic skill length adjustment. By focusing on state transitions and leveraging contrastive learning, DCSL effectively captures the semantic context of behaviors and adapts skill lengths to match the appropriate temporal extent of behaviors. Our approach enables more flexible and adaptive skill extraction, particularly in complex or noisy datasets, and demonstrates competitive performance compared to existing methods in task completion and efficiency.

📄 PDF Abstract BibTeX arXiv:2504.14805

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningDecision MakingReinforcement Learning (RL)

Similar Papers 제목 키워드 기반

CIC: Contrastive Intrinsic Control for Unsupervised Skill Discovery

2022-02-01 · Michael Laskin, Hao liu, Xue Bin Peng, Denis Yarats 외

We introduce Contrastive Intrinsic Control (CIC), an algorithm for unsupervised skill discovery that maximizes the mutual information between state-transitions and latent skill vectors. CIC utilizes contrastive learning …

Contrastive LearningDiversityreinforcement-learningReinforcement Learning (RL)+1

Exploiting Local Dynamics Regularity for Reusable Skills in Offline Hierarchical RL

2026-05-25 · Sarthak Dayal, Abhinav Peri, Carl Qi, Claas Voelcker 외 arxiv

Hierarchical Reinforcement Learning (HRL) promises to solve long-horizon Reinforcement Learning (RL) tasks more efficiently than non-hierarchical counterparts by discovering and reusing temporally-extended skills. Howeve…

Hierarchical Reinforcement Learning

Trace2Tower: Transition-Aware EigenTrace Induction of Multi-Level Skills for LLM Agents

2026-09-04 · Jiazheng Sun, Boyu Yang, Binhao Yuan, Mingxuan Li 외 arxiv

Large language model agents increasingly rely on execution traces to master complex interactive tasks. However, current paradigms are bottlenecked by shallow trajectory retrieval and flat skill summarization, fundamental…

Learning Semantic Atomic Skills for Multi-Task Robotic Manipulation

2025-12-20 · Yihang Zhu, Weiqing Wang, Shijie Wu, Ye Shi 외 arxiv

Scaling imitation learning to diverse multi-task robot manipulation remains challenging due to suboptimal demonstrations, behavioral multi-modality, and destructive interference across tasks. While skill-based methods of…

Robot Manipulation

Latent-Predictive Empowerment: Measuring Empowerment without a Simulator

2024-10-15 · Andrew Levy, Alessandro Allievi, George Konidaris

Empowerment has the potential to help agents learn large skillsets, but is not yet a scalable solution for training general-purpose agents. Recent empowerment methods learn diverse skillsets by maximizing the mutual info…