paper-with-me

Papers

OmniTact: A Multi-Directional High Resolution Touch Sensor

2020-03-16 · Akhil Padmanabha, Frederik Ebert, Stephen Tian, Roberto Calandra, Chelsea Finn, Sergey Levine

Incorporating touch as a sensing modality for robots can enable finer and more robust manipulation skills. Existing tactile sensors are either flat, have small sensitive fields or only provide low-resolution signals. In this paper, we introduce OmniTact, a multi-directional high-resolution tactile sensor. OmniTact is designed to be used as a fingertip for robotic manipulation with robotic hands, and uses multiple micro-cameras to detect multi-directional deformations of a gel-based skin. This provides a rich signal from which a variety of different contact state variables can be inferred using modern image processing and computer vision methods. We evaluate the capabilities of OmniTact on a challenging robotic control task that requires inserting an electrical connector into an outlet, as well as a state estimation problem that is representative of those typically encountered in dexterous robotic manipulation, where the goal is to infer the angle of contact of a curved finger pressing against an object. Both tasks are performed using only touch sensing and deep convolutional neural networks to process images from the sensor's cameras. We compare with a state-of-the-art tactile sensor that is only sensitive on one side, as well as a state-of-the-art multi-directional tactile sensor, and find that OmniTact's combination of high-resolution and multi-directional sensing is crucial for reliably inserting the electrical connector and allows for higher accuracy in the state estimation task. Videos and supplementary material can be found at https://sites.google.com/berkeley.edu/omnitact

📄 PDF Abstract BibTeX arXiv:2003.06965

Code (1)

facebookresearch/tacto pytorch

Tasks

State EstimationVocal Bursts Intensity Prediction

Similar Papers 제목 키워드 기반

TACTO: A Fast, Flexible, and Open-source Simulator for High-Resolution Vision-based Tactile Sensors

2020-12-15 · Shaoxiong Wang, Mike Lambeta, Po-Wei Chou, Roberto Calandra

Simulators perform an important role in prototyping, debugging, and benchmarking new advances in robotics and learning for control. Although many physics engines exist, some aspects of the real world are harder than othe…

Benchmarking

OmniTacTune: Policy-Agnostic Real-World RL for Tactile Residual Adaptation of Visual Policies

2026-07-04 · Kelin Yu, Haode Zhang, Harish Ravichandar, Yunhai Han 외 hf

Visual policies learned from human videos, teleoperation, and robot demonstrations offer scalable motion priors, but often fail in contact-rich manipulation, where success significantly depends on local force and contact…

Digitizing Touch with an Artificial Multimodal Fingertip

2024-11-04 · Mike Lambeta, Tingfan Wu, Ali Sengul, Victoria Rose Most 외

Touch is a crucial sensing modality that provides rich information about object properties and interactions with the physical environment. Humans and robots both benefit from using touch to perceive and interact with the…

ARC

ABPN: Adaptive Blend Pyramid Network for Real-Time Local Retouching of Ultra High-Resolution Photo

2022-01-01 · CVPR 2022 1 · Biwen Lei, Xiefan Guo, Hongyu Yang, Miaomiao Cui 외

Photo retouching finds many applications in various fields. However, most existing methods are designed for global retouching and seldom pay attention to the local region, while the latter is actually much more tedio…

4kGPUPhoto Retouching

An Omnidirectional Approach to Touch-based Continuous Authentication

2023-01-13 · Peter Aaby, Mario Valerio Giuffrida, William J Buchanan, Zhiyuan Tan

This paper focuses on how touch interactions on smartphones can provide a continuous user authentication service through behaviour captured by a touchscreen. While efforts are made to advance touch-based behavioural auth…