paper-with-me

Papers

Advances in Transformers for Robotic Applications: A Review

2024-12-13 · Nikunj Sanghai, Nik Bear Brown

The introduction of Transformers architecture has brought about significant breakthroughs in Deep Learning (DL), particularly within Natural Language Processing (NLP). Since their inception, Transformers have outperformed many traditional neural network architectures due to their "self-attention" mechanism and their scalability across various applications. In this paper, we cover the use of Transformers in Robotics. We go through recent advances and trends in Transformer architectures and examine their integration into robotic perception, planning, and control for autonomous systems. Furthermore, we review past work and recent research on use of Transformers in Robotics as pre-trained foundation models and integration of Transformers with Deep Reinforcement Learning (DRL) for autonomous systems. We discuss how different Transformer variants are being adapted in robotics for reliable planning and perception, increasing human-robot interaction, long-horizon decision-making, and generalization. Finally, we address limitations and challenges, offering insight and suggestions for future research directions.

📄 PDF Abstract BibTeX arXiv:2412.10599

Code (0)

등록된 구현이 없습니다.

Tasks

Decision MakingDeep Reinforcement Learning

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Attention 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Multi-Head Attention 설명 없음
Adam 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

SE(3)-Equivariant Robot Learning and Control: A Tutorial Survey

2025-03-12 · Joohwan Seo, Soochul Yoo, Junwoo Chang, Hyunseok An 외

Recent advances in deep learning and Transformers have driven major breakthroughs in robotics by employing techniques such as imitation learning, reinforcement learning, and LLM-based multimodal perception and decision-m…

Data AugmentationDeep LearningImitation Learning

Automatic Speech Recognition with BERT and CTC Transformers: A Review

2024-10-12 · Noussaiba Djeffal, Hamza Kheddar, Djamel Addou, Ahmed Cherif Mazari 외

This review paper provides a comprehensive analysis of recent advances in automatic speech recognition (ASR) with bidirectional encoder representations from transformers BERT and connectionist temporal classification (CT…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Advances in Medical Image Analysis with Vision Transformers: A Comprehensive Review

2023-01-09 · Reza Azad, Amirhossein Kazerouni, Moein Heidari, Ehsan Khodapanah Aghdam 외

The remarkable performance of the Transformer architecture in natural language processing has recently also triggered broad interest in Computer Vision. Among other merits, Transformers are witnessed as capable of learni…

Medical Image Analysis

Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications

2025-10-08 · Kento Kawaharazuka, Jihoon Oh, Jun Yamada, Ingmar Posner 외 arxiv

Amid growing efforts to leverage advances in large language models (LLMs) and vision-language models (VLMs) for robotics, Vision-Language-Action (VLA) models have recently gained significant attention. By unifying vision…

Data Augmentation

Taxonomy and Trends in Reinforcement Learning for Robotics and Control Systems: A Structured Review

2025-10-11 · Kumater Ter, Abolanle Adetifa, Daniel Udekwe arxiv

Reinforcement learning (RL) has become a foundational approach for enabling intelligent robotic behavior in dynamic and uncertain environments. This work presents an in-depth review of RL principles, advanced deep reinfo…

Reinforcement LearningContinuous Control