paper-with-me

홈 › Papers

A Stereo Algorithm for Thin Obstacles and Reflective Objects

2019-10-03 · John Keller, Sebastian Scherer

Stereo cameras are a popular choice for obstacle avoidance for outdoor lighweight, low-cost robotics applications. However, they are unable to sense thin and reflective objects well. Currently, many algorithms are tuned to perform well on indoor scenes like the Middlebury dataset. When navigating outdoors, reflective objects, like windows and glass, and thin obstacles, like wires, are not well handled by most stereo disparity algorithms. Reflections, repeating patterns and objects parallel to the cameras' baseline causes mismatches between image pairs which leads to bad disparity estimates. Thin obstacles are difficult for many sliding window based disparity methods to detect because they do not take up large portions of the pixels in the sliding window. We use a trinocular camera setup and micropolarizer camera capable of detecting reflective objects to overcome these issues. We present a hierarchical disparity algorithm that reduces noise, separately identify wires using semantic object triangulation in three images, and use information about the polarization of light to estimate the disparity of reflective objects. We evaluate our approach on outdoor data that we collected. Our method contained an average of 9.27% of bad pixels compared to a typical stereo algorithm's 18.4% of bad pixels in scenes containing reflective objects. Our trinocular and semantic wire disparity methods detected 53% of wire pixels, whereas a typical two camera stereo algorithm detected 5%.

📄 PDF Abstract BibTeX arXiv:1910.04874

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

A Learned Stereo Depth System for Robotic Manipulation in Homes

2021-09-23 · Krishna Shankar, Mark Tjersland, Jeremy Ma, Kevin Stone 외

We present a passive stereo depth system that produces dense and accurate point clouds optimized for human environments, including dark, textureless, thin, reflective and specular surfaces and objects, at 2560x2048 resol…

Stereo Matching

NeRF-Supervision: Learning Dense Object Descriptors from Neural Radiance Fields

2022-03-03 · Lin Yen-Chen, Pete Florence, Jonathan T. Barron, Tsung-Yi Lin 외

Thin, reflective objects such as forks and whisks are common in our daily lives, but they are particularly challenging for robot perception because it is hard to reconstruct them using commodity RGB-D cameras or multi-vi…

NeRF

Next-Best-View Prediction for Active Stereo Cameras and Highly Reflective Objects

2022-02-27 · Jun Yang, Steven L. Waslander

Depth acquisition with the active stereo camera is a challenging task for highly reflective objects. When setup permits, multi-view fusion can provide increased levels of depth completion. However, due to the slow acquis…

Depth CompletionPose Estimation

Fast, Accurate Thin-Structure Obstacle Detection for Autonomous Mobile Robots

2017-08-14 · Chen Zhou, Jiaolong Yang, Chunshui Zhao, Gang Hua

Safety is paramount for mobile robotic platforms such as self-driving cars and unmanned aerial vehicles. This work is devoted to a task that is indispensable for safety yet was largely overlooked in the past -- detecting…

Self-Driving CarsVisual Odometry

ClearDepth: Enhanced Stereo Perception of Transparent Objects for Robotic Manipulation

2024-09-13 · Kaixin Bai, Huajian Zeng, Lei Zhang, YiWen Liu 외

Transparent object depth perception poses a challenge in everyday life and logistics, primarily due to the inability of standard 3D sensors to accurately capture depth on transparent or reflective surfaces. This limitati…

Transparent objects