paper-with-me

Papers

Deep Neighbor Layer Aggregation for Lightweight Self-Supervised Monocular Depth Estimation

2023-09-17 · Wang Boya, Wang Shuo, Ye Dong, Dou Ziwen

With the frequent use of self-supervised monocular depth estimation in robotics and autonomous driving, the model's efficiency is becoming increasingly important. Most current approaches apply much larger and more complex networks to improve the precision of depth estimation. Some researchers incorporated Transformer into self-supervised monocular depth estimation to achieve better performance. However, this method leads to high parameters and high computation. We present a fully convolutional depth estimation network using contextual feature fusion. Compared to UNet++ and HRNet, we use high-resolution and low-resolution features to reserve information on small targets and fast-moving objects instead of long-range fusion. We further promote depth estimation results employing lightweight channel attention based on convolution in the decoder stage. Our method reduces the parameters without sacrificing accuracy. Experiments on the KITTI benchmark show that our method can get better results than many large models, such as Monodepth2, with only 30 parameters. The source code is available at https://github.com/boyagesmile/DNA-Depth.

📄 PDF Abstract BibTeX arXiv:2309.09272

Code (1)

boyagesmile/dna-depth 공식 구현 pytorch

Tasks

Autonomous DrivingDecoderDepth EstimationMonocular Depth Estimation

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
Attention 설명 없음
Batch Normalization 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
HRNet HRNet, or High-Resolution Net, is a general purpose convolutional neural network for tasks like semantic segmentation, object detection and image classification. It is…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

Interpolation between Convolution and Attention via K-Nearest Neighbors

2026-05-31 · Mingi Kang arxiv

The shift from Convolutional Neural Networks to Transformers has reshaped computer vision, yet these two architectural families are typically viewed as fundamentally distinct. Convolutional Neural Networks are defined by…

Recurrent Self-Supervised Video Denoising with Denser Receptive Field

2023-08-07 · Zichun Wang, Yulun Zhang, Debing Zhang, Ying Fu

Self-supervised video denoising has seen decent progress through the use of blind spot networks. However, under their blind spot constraints, previous self-supervised video denoising methods suffer from significant infor…

DenoisingVideo Denoising

Modelling Neighbor Relation in Joint Space-Time Graph for Video Correspondence Learning

2021-09-28 · ICCV 2021 10 · Zixu Zhao, Yueming Jin, Pheng-Ann Heng

This paper presents a self-supervised method for learning reliable visual correspondence from unlabeled videos. We formulate the correspondence as finding paths in a joint space-time graph, where nodes are grid patches s…

Contrastive LearningRelation

Unveiling Contrastive Learning's Capability of Neighborhood Aggregation for Collaborative Filtering

2025-04-14 · Yu Zhang, Yiwen Zhang, Yi Zhang, Lei Sang 외

Personalized recommendation is widely used in the web applications, and graph contrastive learning (GCL) has gradually become a dominant approach in recommender systems, primarily due to its ability to extract self-super…

Collaborative FilteringContrastive LearningData AugmentationMisconceptions+1

Micro-video recommendation model based on graph neural network and attention mechanism

2022-05-21 · Chan Ching Ting, Mathew Bowles, Ibrahim Idewu

With the rapid development of Internet technology and the comprehensive popularity of Internet applications, online activities have gradually become an indispensable part of people's daily life. The original recommendati…

Graph Neural Network