paper-with-me

Papers

Depth-CUPRL: Depth-Imaged Contrastive Unsupervised Prioritized Representations in Reinforcement Learning for Mapless Navigation of Unmanned Aerial Vehicles

2022-06-30 · Junior Costa de Jesus, Victor Augusto Kich, Alisson Henrique Kolling, Ricardo Bedin Grando, Rodrigo da Silva Guerra, Paulo Lilles Jorge Drews Jr

Reinforcement Learning (RL) has presented an impressive performance in video games through raw pixel imaging and continuous control tasks. However, RL performs poorly with high-dimensional observations such as raw pixel images. It is generally accepted that physical state-based RL policies such as laser sensor measurements give a more sample-efficient result than learning by pixels. This work presents a new approach that extracts information from a depth map estimation to teach an RL agent to perform the mapless navigation of Unmanned Aerial Vehicle (UAV). We propose the Depth-Imaged Contrastive Unsupervised Prioritized Representations in Reinforcement Learning(Depth-CUPRL) that estimates the depth of images with a prioritized replay memory. We used a combination of RL and Contrastive Learning to lead with the problem of RL based on images. From the analysis of the results with Unmanned Aerial Vehicles (UAVs), it is possible to conclude that our Depth-CUPRL approach is effective for the decision-making and outperforms state-of-the-art pixel-based approaches in the mapless navigation capability.

📄 PDF Abstract BibTeX arXiv:2206.15211

Code (0)

등록된 구현이 없습니다.

Tasks

continuous-controlContinuous ControlContrastive LearningDecision Makingreinforcement-learningReinforcement LearningReinforcement Learning (RL)

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Copy-Pasting Coherent Depth Regions Improves Contrastive Learning for Urban-Scene Segmentation

2022-11-25 · Liang Zeng, Attila Lengyel, Nergis Tömen, Jan van Gemert

In this work, we leverage estimated depth to boost self-supervised contrastive learning for segmentation of urban scenes, where unlabeled videos are readily available for training self-supervised depth estimation. We arg…

Contrastive LearningDepth EstimationScene SegmentationSegmentation+2

Motion-Depth: RGB-D Depth Map Enhancement with Motion and Depth in Complement

2014-06-01 · CVPR 2014 6 · Tak-Wai Hui, King Ngi Ngan

Low-cost RGB-D imaging system such as Kinect is widely utilized for dense 3D reconstruction. However, RGB-D system generally suffers from two main problems. The spatial resolution of the depth image is low. The depth ima…

3D ReconstructionImage EnhancementOptical Flow Estimation

SaccadeCam: Adaptive Visual Attention for Monocular Depth Sensing

2021-03-24 · ICCV 2021 10 · Brevin Tilmon, Sanjeev J. Koppal

Most monocular depth sensing methods use conventionally captured images that are created without considering scene content. In contrast, animal eyes have fast mechanical motions, called saccades, that control how the sce…

Depth EstimationMonocular Depth Estimation

Neural Camera Models

2022-08-27 · Igor Vasiljevic

Modern computer vision has moved beyond the domain of internet photo collections and into the physical world, guiding camera-equipped robots and autonomous cars through unstructured environments. To enable these embodied…

Depth Estimation

Can Language Understand Depth?

2022-07-03 · Renrui Zhang, Ziyao Zeng, Ziyu Guo, Yafeng Li

Besides image classification, Contrastive Language-Image Pre-training (CLIP) has accomplished extraordinary success for a wide range of vision tasks, including object-level and 3D space understanding. However, it's still…

Depth Estimationimage-classificationImage ClassificationMonocular Depth Estimation