paper-with-me

홈 › Papers

Depth Estimation using Weighted-loss and Transfer Learning

2024-04-11 · Muhammad Adeel Hafeez, Michael G. Madden, Ganesh Sistu, Ihsan Ullah

Depth estimation from 2D images is a common computer vision task that has applications in many fields including autonomous vehicles, scene understanding and robotics. The accuracy of a supervised depth estimation method mainly relies on the chosen loss function, the model architecture, quality of data and performance metrics. In this study, we propose a simplified and adaptable approach to improve depth estimation accuracy using transfer learning and an optimized loss function. The optimized loss function is a combination of weighted losses to which enhance robustness and generalization: Mean Absolute Error (MAE), Edge Loss and Structural Similarity Index (SSIM). We use a grid search and a random search method to find optimized weights for the losses, which leads to an improved model. We explore multiple encoder-decoder-based models including DenseNet121, DenseNet169, DenseNet201, and EfficientNet for the supervised depth estimation model on NYU Depth Dataset v2. We observe that the EfficientNet model, pre-trained on ImageNet for classification when used as an encoder, with a simple upsampling decoder, gives the best results in terms of RSME, REL and log10: 0.386, 0.113 and 0.049, respectively. We also perform a qualitative analysis which illustrates that our model produces depth maps that closely resemble ground truth, even in cases where the ground truth is flawed. The results indicate significant improvements in accuracy and robustness, with EfficientNet being the most successful architecture.

📄 PDF Abstract BibTeX arXiv:2404.07686

Code (0)

등록된 구현이 없습니다.

Tasks

Autonomous VehiclesDecoderDepth EstimationScene UnderstandingSSIMTransfer Learning

Methods 이 논문이 사용한 방법론

(FiLe@Against@Claim)How do I file a claim against Expedia? How do I file a claim against Expedia? How Do I File a Claim Against Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Fast Help &…
Pointwise Convolution Pointwise Convolution is a type of convolution that uses a 1x1 kernel: a kernel that iterates through every single point. This…
Depthwise Convolution Depthwise Convolution is a type of convolution where we apply a single convolutional filter for each input channel. In the regular 2D…
Depthwise Separable Convolution While standard convolution performs the channelwise and spatial-wise computation in one step, Depthwise Separable Convolution …
Batch Normalization 설명 없음
RMSProp RMSProp is an unpublished adaptive learning rate optimizer proposed by Geoff Hinton. The motivation…
Average Pooling 설명 없음
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…

Similar Papers 제목 키워드 기반

Relative Depth Estimation as a Ranking Problem

2020-10-14 · Alican Mertan, Damien Jade Duff, Gozde Unal

We present a formulation of the relative depth estimation from a single image problem, as a ranking problem. By reformulating the problem this way, we were able to utilize literature on the ranking problem, and apply the…

Depth Estimation

Deep Surface Normal Estimation with Hierarchical RGB-D Fusion

2019-04-06 · CVPR 2019 6 · Jin Zeng, Yanfeng Tong, Yunmu Huang, Qiong Yan 외

The growing availability of commodity RGB-D cameras has boosted the applications in the field of scene understanding. However, as a fundamental scene understanding task, surface normal estimation from RGB-D data lacks th…

Scene UnderstandingSurface Normal Estimation

Self-supervised Learning of Occlusion Aware Flow Guided 3D Geometry Perception with Adaptive Cross Weighted Loss from Monocular Videos

2021-08-09 · Jiaojiao Fang, Guizhong Liu

Self-supervised deep learning-based 3D scene understanding methods can overcome the difficulty of acquiring the densely labeled ground-truth and have made a lot of advances. However, occlusions and moving objects are sti…

3D geometry3D Geometry PerceptionCamera Pose EstimationOptical Flow Estimation+3

Multi-Camera Collaborative Depth Prediction via Consistent Structure Estimation

2022-10-05 · Jialei Xu, Xianming Liu, Yuanchao Bai, Junjun Jiang 외

Depth map estimation from images is an important task in robotic systems. Existing methods can be categorized into two groups including multi-view stereo and monocular depth estimation. The former requires cameras to hav…

Depth EstimationDepth PredictionMonocular Depth EstimationPrediction

Multimodal Scale Consistency and Awareness for Monocular Self-Supervised Depth Estimation

2021-03-03 · Hemang Chawla, Arnav Varma, Elahe Arani, Bahram Zonooz

Dense depth estimation is essential to scene-understanding for autonomous driving. However, recent self-supervised approaches on monocular videos suffer from scale-inconsistency across long sequences. Utilizing data from…

Autonomous DrivingDepth EstimationMonocular Depth EstimationScene Understanding