paper-with-me

홈 › Papers

You're Pushing My Buttons: Instrumented Learning of Gentle Button Presses

2026-04-07 · Raman Talwar, Remko Proesmans, Thomas Lips, Andreas Verleysen, Francis wyffels arxiv

Learning contact-rich manipulation is difficult from cameras and proprioception alone because contact events are only partially observed. We test whether training-time instrumentation, i.e., object sensorisation, can improve policy performance without creating deployment-time dependencies. Specifically, we study button pressing as a testbed and use a microphone fingertip to capture contact-relevant audio. We use an instrumented button-state signal as privileged supervision to fine-tune an audio encoder into a contact event detector. We combine the resulting representation with imitation learning using three strategies, such that the policy only uses vision and audio during inference. Button press success rates are similar across methods, but instrumentation-guided audio representations consistently reduce contact force. These results support instrumentation as a practical training-time auxiliary objective for learning contact-rich manipulation policies.

📄 PDF Abstract BibTeX arXiv:2604.05954

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A User Study on the Suitability of Teleoperation Interfaces for Primitive Manipulation Tasks

2026-02-03 · Jun Aoki, Shunki Itadera arxiv

The application of teleoperation to control robotic arms has been widely explored, and user-friendly teleoperation systems have been studied for facilitating higher performance and lower operational burden. To investigat…

Piano Genie

2018-10-11 · Chris Donahue, Ian Simon, Sander Dieleman

We present Piano Genie, an intelligent controller which allows non-musicians to improvise on the piano. With Piano Genie, a user performs on a simple interface with eight buttons, and their performance is decoded into th…

Decoder

Autonomous Removal of Perspective Distortion of Elevator Button Images based on Corner Detection

2020-07-23 · Nachuan Ma, Jianbang Liu, Delong Zhu

Elevator button recognition is a critical function to realize the autonomous operation of elevators. However, challenging image conditions and various image distortions make it difficult to recognize buttons accurately. …

Image SegmentationSegmentationSemantic Segmentation

FITS: Ensuring Safe and Effective Touchscreen Use in Moving Vehicles

2024-12-24 · Daan M. Pool, Yasemin Vardar

Touch interfaces are replacing physical buttons, dials, and switches in the new generation of cars, aircraft, and vessels. However, vehicle vibrations and accelerations perturb finger movements and cause erroneous touchs…

Pushing the Right Buttons: Adversarial Evaluation of Quality Estimation

2021-09-22 · WMT (EMNLP) 2021 11 · Diptesh Kanojia, Marina Fomicheva, Tharindu Ranasinghe, Frédéric Blain 외

Current Machine Translation (MT) systems achieve very good results on a growing variety of language pairs and datasets. However, they are known to produce fluent translation outputs that can contain important meaning err…

Machine TranslationTranslation