paper-with-me

홈 › Papers

On the Efficacy of 3D Point Cloud Reinforcement Learning

2023-06-11 · Zhan Ling, Yunchao Yao, Xuanlin Li, Hao Su

Recent studies on visual reinforcement learning (visual RL) have explored the use of 3D visual representations. However, none of these work has systematically compared the efficacy of 3D representations with 2D representations across different tasks, nor have they analyzed 3D representations from the perspective of agent-object / object-object relationship reasoning. In this work, we seek answers to the question of when and how do 3D neural networks that learn features in the 3D-native space provide a beneficial inductive bias for visual RL. We specifically focus on 3D point clouds, one of the most common forms of 3D representations. We systematically investigate design choices for 3D point cloud RL, leading to the development of a robust algorithm for various robotic manipulation and control tasks. Furthermore, through comparisons between 2D image vs 3D point cloud RL methods on both minimalist synthetic tasks and complex robotic manipulation tasks, we find that 3D point cloud RL can significantly outperform the 2D counterpart when agent-object / object-object relationship encoding is a key factor.

📄 PDF Abstract BibTeX arXiv:2306.06799

Code (1)

lz1oceani/pointcloud_rl 공식 구현 pytorch

Tasks

3D Point Cloud Reinforcement LearningInductive BiasObjectreinforcement-learningReinforcement LearningRobot Manipulation

Methods 이 논문이 사용한 방법론

None 설명 없음
Focus 설명 없음

Similar Papers 제목 키워드 기반

An Efficient Hypergraph Approach to Robust Point Cloud Resampling

2021-03-11 · Qinwen Deng, Songyang Zhang, Zhi Ding

Efficient processing and feature extraction of largescale point clouds are important in related computer vision and cyber-physical systems. This work investigates point cloud resampling based on hypergraph signal process…

Point cloud segmentation using hierarchical tree for architectural models

2018-06-22 · Omair Hassaan, Abeera Shamail, Zain Butt, Murtaza Taj

Recent developments in the 3D scanning technologies have made the generation of highly accurate 3D point clouds relatively easy but the segmentation of these point clouds remains a challenging area. A number of technique…

Point Cloud SegmentationSegmentation

Hypergraph Spectral Analysis and Processing in 3D Point Cloud

2020-01-08 · Songyang Zhang, Shuguang Cui, Zhi Ding

Along with increasingly popular virtual reality applications, the three-dimensional (3D) point cloud has become a fundamental data structure to characterize 3D objects and surroundings. To process 3D point clouds efficie…

Denoising

Mahalanobis k-NN: A Statistical Lens for Robust Point-Cloud Registrations

2024-09-10 · Tejas Anvekar, Shivanand Venkanna Sheshappanavar

In this paper, we discuss Mahalanobis k-NN: A Statistical Lens designed to address the challenges of feature matching in learning-based point cloud registration when confronted with an arbitrary density of point clouds. …

BenchmarkingPoint Cloud Registration

Robust Point Cloud Reinforcement Learning via PCA-Based Canonicalization

2025-10-23 · Michael Bezick, Vittorio Giammarino, Ahmed H. Qureshi arxiv

Reinforcement Learning (RL) from raw visual input has achieved impressive successes in recent years, yet it remains fragile to out-of-distribution variations such as changes in lighting, color, and viewpoint. Point Cloud…

Reinforcement LearningPoint Clouds