Transformer in Touch: A Survey

2024-05-21 · Jing Gao, Ning Cheng, Bin Fang, Wenjuan Han

The Transformer model, initially achieving significant success in the field of natural language processing, has recently shown great potential in the application of tactile perception. This review aims to comprehensively outline the application and development of Transformers in tactile technology. We first introduce the two fundamental concepts behind the success of the Transformer: the self-attention mechanism and large-scale pre-training. Then, we delve into the application of Transformers in various tactile tasks, including but not limited to object recognition, cross-modal generation, and object manipulation, offering a concise summary of the core methodologies, performance benchmarks, and design highlights. Finally, we suggest potential areas for further research and future work, aiming to generate more interest within the community, tackle existing challenges, and encourage the use of Transformer models in the tactile field.

📄 PDF Abstract BibTeX arXiv:2405.12779

Code (0)

등록된 구현이 없습니다.

Tasks

Object RecognitionSurvey

Methods 이 논문이 사용한 방법론

Attention 설명 없음

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Position-Wise Feed-Forward Layer 설명 없음

Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Residual Connection 설명 없음

Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Understanding Embodied Reference with Touch-Line Transformer

2022-10-11 · Yang Li, Xiaoxue Chen, Hao Zhao, Jiangtao Gong 외

We study embodied reference understanding, the task of locating referents using embodied gestural signals and language references. Human studies have revealed that objects referred to or pointed to do not lie on the elbo…

VRetouchEr: Learning Cross-frame Feature Interdependence with Imperfection Flow for Face Retouching in Videos

2024-01-01 · CVPR 2024 1 · Wen Xue, Le Jiang, Lianxin Xie, Si Wu 외

Face Video Retouching is a complex task that often requires labor-intensive manual editing. Conventional image retouching methods perform less satisfactorily in terms of generalization performance and stability when …

Image Retouching

Neural Entity Linking: A Survey of Models Based on Deep Learning

2020-05-31 · Ozge Sevgili, Artem Shelmanov, Mikhail Arkhipov, Alexander Panchenko 외

This survey presents a comprehensive description of recent neural entity linking (EL) systems developed since 2015 as a result of the "deep learning revolution" in natural language processing. Its goal is to systemize de…

Deep Learning Entity Embeddings Entity Linking Survey

From constant to rough: A survey of continuous volatility modeling

2023-09-02 · Giulia Di Nunno, Kęstutis Kubilius, Yuliya Mishura, Anton Yurchenko-Tytarenko

In this paper, we present a comprehensive survey of continuous stochastic volatility models, discussing their historical development and the key stylized facts that have driven the field. Special attention is dedicated t…

Survey

Agents That Know Too Much: A Data-Centric Survey of Privacy in LLM Agents

2026-06-25 · Nada Lahjouji, Ashwin Gerard Colaco arxiv

Large language model agents increasingly query databases, search document collections, call external APIs, remember past interactions, and act on a user's behalf. As they move from answering questions to operating over s…