paper-with-me

홈 › Papers

Contrastive Imitation Learning for Language-guided Multi-Task Robotic Manipulation

2024-06-14 · Teli Ma, Jiaming Zhou, Zifan Wang, Ronghe Qiu, Junwei Liang

Developing robots capable of executing various manipulation tasks, guided by natural language instructions and visual observations of intricate real-world environments, remains a significant challenge in robotics. Such robot agents need to understand linguistic commands and distinguish between the requirements of different tasks. In this work, we present Sigma-Agent, an end-to-end imitation learning agent for multi-task robotic manipulation. Sigma-Agent incorporates contrastive Imitation Learning (contrastive IL) modules to strengthen vision-language and current-future representations. An effective and efficient multi-view querying Transformer (MVQ-Former) for aggregating representative semantic information is introduced. Sigma-Agent shows substantial improvement over state-of-the-art methods under diverse settings in 18 RLBench tasks, surpassing RVT by an average of 5.2% and 5.9% in 10 and 100 demonstration training, respectively. Sigma-Agent also achieves 62% success rate with a single policy in 5 real-world manipulation tasks. The code will be released upon acceptance.

📄 PDF Abstract BibTeX arXiv:2406.09738

Code (0)

등록된 구현이 없습니다.

Tasks

Imitation Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

Syntax-guided Contrastive Learning for Pre-trained Language Model

2022-05-01 · Findings (ACL) 2022 5 · Shuai Zhang, Wang Lijie, Xinyan Xiao, Hua Wu

Syntactic information has been proved to be useful for transformer-based pre-trained language models. Previous studies often rely on additional syntax-guided attention components to enhance the transformer, which require…

Contrastive LearningGrammatical Error DetectionLanguage ModelingLanguage Modelling

Language-guided Medical Image Segmentation with Target-informed Multi-level Contrastive Alignments

2024-12-18 · Mingjian Li, Mingyuan Meng, Shuchang Ye, David Dagan Feng 외

Medical image segmentation is crucial in modern medical image analysis, which can aid into diagnosis of various disease conditions. Recently, language-guided segmentation methods have shown promising results in automatin…

Image SegmentationMedical Image AnalysisMedical Image SegmentationRepresentation Learning+2

Gradient-Attention Guided Dual-Masking Synergetic Framework for Robust Text-based Person Retrieval

2025-09-11 · Tianlu Zheng, Yifan Zhang, Xiang An, Ziyong Feng 외 arxiv

Although Contrastive Language-Image Pre-training (CLIP) exhibits strong performance across diverse vision tasks, its application to person representation learning faces two critical challenges: (i) the scarcity of large-…

Representation LearningContrastive LearningPerson Retrieval

CATALOG: A Camera Trap Language-guided Contrastive Learning Model

2024-12-14 · Julian D. Santamaria, Claudia Isaza, Jhony H. Giraldo

Foundation Models (FMs) have been successful in various computer vision tasks like image classification, object detection and image segmentation. However, these tasks remain challenging when these models are tested on da…

Contrastive Learningimage-classificationImage ClassificationImage Segmentation+3

GraSS: Contrastive Learning with Gradient Guided Sampling Strategy for Remote Sensing Image Semantic Segmentation

2023-06-28 · Zhaoyang Zhang, Zhen Ren, Chao Tao, Yunsheng Zhang 외

Self-supervised contrastive learning (SSCL) has achieved significant milestones in remote sensing image (RSI) understanding. Its essence lies in designing an unsupervised instance discrimination pretext task to extract i…

Contrastive LearningSegmentationSemantic Segmentation