paper-with-me

홈 › Papers

The Sum of Its Parts: Visual Part Segmentation for Inertial Parameter Identification of Manipulated Objects

2023-02-13 · Philippe Nadeau, Matthew Giamou, Jonathan Kelly

To operate safely and efficiently alongside human workers, collaborative robots (cobots) require the ability to quickly understand the dynamics of manipulated objects. However, traditional methods for estimating the full set of inertial parameters rely on motions that are necessarily fast and unsafe (to achieve a sufficient signal-to-noise ratio). In this work, we take an alternative approach: by combining visual and force-torque measurements, we develop an inertial parameter identification algorithm that requires slow or 'stop-and-go' motions only, and hence is ideally tailored for use around humans. Our technique, called Homogeneous Part Segmentation (HPS), leverages the observation that man-made objects are often composed of distinct, homogeneous parts. We combine a surface-based point clustering method with a volumetric shape segmentation algorithm to quickly produce a part-level segmentation of a manipulated object; the segmented representation is then used by HPS to accurately estimate the object's inertial parameters. To benchmark our algorithm, we create and utilize a novel dataset consisting of realistic meshes, segmented point clouds, and inertial parameters for 20 common workshop tools. Finally, we demonstrate the real-world performance and accuracy of HPS by performing an intricate 'hammer balancing act' autonomously and online with a low-cost collaborative robotic arm. Our code and dataset are open source and freely available.

📄 PDF Abstract BibTeX arXiv:2302.06685

Code (1)

utiasSTARS/inertial-identification-with-part-segmentation 공식 구현

Tasks

Segmentation

Similar Papers 제목 키워드 기반

Visual-Inertial Localization for Skid-Steering Robots with Kinematic Constraints

2019-11-13 · Xingxing Zuo, Mingming Zhang, Yiming Chen, Yong liu 외

While visual localization or SLAM has witnessed great progress in past decades, when deploying it on a mobile robot in practice, few works have explicitly considered the kinematic (or dynamic) constraints of the real rob…

parameter estimationVisual Localization

R3LIVE: A Robust, Real-time, RGB-colored, LiDAR-Inertial-Visual tightly-coupled state Estimation and mapping package

2021-09-10 · Jiarong Lin, Fu Zhang

In this letter, we propose a novel LiDAR-Inertial-Visual sensor fusion framework termed R3LIVE, which takes advantage of measurement of LiDAR, inertial, and visual sensors to achieve robust and accurate state estimation.…

Sensor FusionState Estimation

A Visual-inertial Navigation Method for High-Speed Unmanned Aerial Vehicles

2020-02-12 · Xin-long Luo, Jia-hui Lv, Geng Sun

This paper investigates the localization problem of high-speed high-altitude unmanned aerial vehicle (UAV) with a monocular camera and inertial navigation system. It proposes a navigation method utilizing the complementa…

Vocal Bursts Intensity Prediction

eKalibr-Inertial: Continuous-Time Spatiotemporal Calibration for Event-Based Visual-Inertial Systems

2025-09-07 · Shuolong Chen, Xingxing Li, Liu Yuan arxiv

The bioinspired event camera, distinguished by its exceptional temporal resolution, high dynamic range, and low power consumption, has been extensively studied in recent years for motion estimation, robotic perception, a…

Object Detection

EVIMO2: An Event Camera Dataset for Motion Segmentation, Optical Flow, Structure from Motion, and Visual Inertial Odometry in Indoor Scenes with Monocular or Stereo Algorithms

2022-05-06 · Levi Burner, Anton Mitrokhin, Cornelia Fermüller, Yiannis Aloimonos

A new event camera dataset, EVIMO2, is introduced that improves on the popular EVIMO dataset by providing more data, from better cameras, in more complex scenarios. As with its predecessor, EVIMO2 provides labels in the …

Motion SegmentationOptical Flow EstimationSegmentationSemantic Segmentation