paper-with-me

홈 › Papers

SwinDepth: Unsupervised Depth Estimation using Monocular Sequences via Swin Transformer and Densely Cascaded Network

2023-01-17 · Dongseok Shim, H. Jin Kim

Monocular depth estimation plays a critical role in various computer vision and robotics applications such as localization, mapping, and 3D object detection. Recently, learning-based algorithms achieve huge success in depth estimation by training models with a large amount of data in a supervised manner. However, it is challenging to acquire dense ground truth depth labels for supervised training, and the unsupervised depth estimation using monocular sequences emerges as a promising alternative. Unfortunately, most studies on unsupervised depth estimation explore loss functions or occlusion masks, and there is little change in model architecture in that ConvNet-based encoder-decoder structure becomes a de-facto standard for depth estimation. In this paper, we employ a convolution-free Swin Transformer as an image feature extractor so that the network can capture both local geometric features and global semantic features for depth estimation. Also, we propose a Densely Cascaded Multi-scale Network (DCMNet) that connects every feature map directly with another from different scales via a top-down cascade pathway. This densely cascaded connectivity reinforces the interconnection between decoding layers and produces high-quality multi-scale depth outputs. The experiments on two different datasets, KITTI and Make3D, demonstrate that our proposed method outperforms existing state-of-the-art unsupervised algorithms.

📄 PDF Abstract BibTeX arXiv:2301.06715

Code (1)

dsshim0125/SwinDepth 공식 구현 pytorch

Tasks

3D Object DetectionDecoderDepth EstimationMonocular Depth Estimationobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Position-Wise Feed-Forward Layer 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Adam 설명 없음
Stochastic Depth Stochastic Depth aims to shrink the depth of a network during training, while keeping it unchanged during testing. This is achieved by randomly dropping entire…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

MiniNet: An extremely lightweight convolutional neural network for real-time unsupervised monocular depth estimation

2020-06-27 · Jun Liu, Qing Li, Rui Cao, Wenming Tang 외

Predicting depth from a single image is an attractive research topic since it provides one more dimension of information to enable machines to better perceive the world. Recently, deep learning has emerged as an effectiv…

CPUDepth EstimationDepth PredictionGPU+4

Unsupervised Simultaneous Learning for Camera Re-Localization and Depth Estimation from Video

2022-03-24 · Shun Taguchi, Noriaki Hirose

We present an unsupervised simultaneous learning framework for the task of monocular camera re-localization and depth estimation from unlabeled video sequences. Monocular camera re-localization refers to the task of esti…

Depth EstimationMonocular Depth Estimation

Unsupervised Deep Persistent Monocular Visual Odometry and Depth Estimation in Extreme Environments

2020-10-31 · Yasin Almalioglu, Angel Santamaria-Navarro, Benjamin Morrell, Ali-akbar Agha-mohammadi

In recent years, unsupervised deep learning approaches have received significant attention to estimate the depth and visual odometry (VO) from unlabelled monocular image sequences. However, their performance is limited i…

Depth EstimationMonocular Visual OdometryPose EstimationVisual Odometry

Unsupervised Learning of Monocular Depth Estimation with Bundle Adjustment, Super-Resolution and Clip Loss

2018-12-08 · Lipu Zhou, Jiamin Ye, Montiel Abello, Shengze Wang 외

We present a novel unsupervised learning framework for single view depth estimation using monocular videos. It is well known in 3D vision that enlarging the baseline can increase the depth estimation accuracy, and jointl…

Depth EstimationMonocular Depth EstimationSuper-Resolution

Unsupervised Learning of Depth and Ego-Motion from Video

2017-04-25 · CVPR 2017 7 · Tinghui Zhou, Matthew Brown, Noah Snavely, David G. Lowe

We present an unsupervised learning framework for the task of monocular depth and camera motion estimation from unstructured video sequences. We achieve this by simultaneously training depth and camera pose estimation ne…

Camera Pose EstimationDepth And Camera MotionDepth EstimationMotion Estimation+1