Intuitive Tasks Planning Using Visuo-Tactile Perception for Human Robot Cooperation
Designing robotic tasks for co-manipulation necessitates to exploit not only proprioceptive but also exteroceptive information for improved safety and autonomy. Following such instinct, this research proposes to formulate intuitive robotic tasks following human viewpoint by incorporating visuo-tactile perception. The visual data using depth cameras surveils and determines the object dimensions and human intentions while the tactile sensing ensures to maintain the desired contact to avoid slippage. Experiment performed on robot platform with human assistance under industrial settings validates the performance and applicability of proposed intuitive task formulation.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Universal Visuo-Tactile Video Understanding for Embodied Interaction
Tactile perception is essential for embodied agents to understand physical attributes of objects that cannot be determined through visual inspection alone. While existing approaches have made progress in visual and langu…
FrictionLarge Language ModelText GenerationVideo UnderstandingVisuotactile Affordances for Cloth Manipulation with Local Control
Cloth in the real world is often crumpled, self-occluded, or folded in on itself such that key regions, such as corners, are not directly graspable, making manipulation difficult. We propose a system that leverages visua…
Edge ClassificationPose EstimationUniVTAC: A Unified Simulation Platform for Visuo-Tactile Manipulation Data Generation, Learning, and Benchmarking
Robotic manipulation has seen rapid progress with vision-language-action (VLA) policies. However, visuo-tactile perception is critical for contact-rich manipulation, as tasks such as insertion are difficult to complete r…
AnyTouch: Learning Unified Static-Dynamic Representation across Multiple Visuo-tactile Sensors
Visuo-tactile sensors aim to emulate human tactile perception, enabling robots to precisely understand and manipulate objects. Over time, numerous meticulously designed visuo-tactile sensors have been integrated into rob…
Representation LearningTransfer LearningsimPLE: a visuotactile method learned in simulation to precisely pick, localize, regrasp, and place objects
Existing robotic systems have a clear tension between generality and precision. Deployed solutions for robotic manipulation tend to fall into the paradigm of one robot solving a single task, lacking precise generalizatio…