paper-with-me

홈 › Papers

Object Detection in Foggy Scenes by Embedding Depth and Reconstruction into Domain Adaptation

2022-11-24 · Xin Yang, Michael Bi Mi, Yuan Yuan, Xin Wang, Robby T. Tan

Most existing domain adaptation (DA) methods align the features based on the domain feature distributions and ignore aspects related to fog, background and target objects, rendering suboptimal performance. In our DA framework, we retain the depth and background information during the domain feature alignment. A consistency loss between the generated depth and fog transmission map is introduced to strengthen the retention of the depth information in the aligned features. To address false object features potentially generated during the DA process, we propose an encoder-decoder framework to reconstruct the fog-free background image. This reconstruction loss also reinforces the encoder, i.e., our DA backbone, to minimize false object features.Moreover, we involve our target data in training both our DA module and our detection module in a semi-supervised manner, so that our detection module is also exposed to the unlabeled target data, the type of data used in the testing stage. Using these ideas, our method significantly outperforms the state-of-the-art method (47.6 mAP against the 44.3 mAP on the Foggy Cityscapes dataset), and obtains the best performance on multiple real-image public datasets. Code is available at: https://github.com/VIML-CVDL/Object-Detection-in-Foggy-Scenes

📄 PDF Abstract BibTeX arXiv:2211.13409

Code (1)

viml-cvdl/object-detection-in-foggy-scenes 공식 구현 pytorch

Tasks

DecoderDomain AdaptationObjectobject-detectionObject Detection

Methods 이 논문이 사용한 방법론

ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

Unsupervised Cumulative Domain Adaptation for Foggy Scene Optical Flow

2023-03-14 · CVPR 2023 1 · Hanyu Zhou, Yi Chang, Wending Yan, Luxin Yan

Optical flow has achieved great success under clean scenes, but suffers from restricted performance under foggy scenes. To bridge the clean-to-foggy domain gap, the existing methods typically adopt the domain adaptation …

Domain AdaptationOptical Flow Estimation

MonoTDP: Twin Depth Perception for Monocular 3D Object Detection in Adverse Scenes

2023-05-18 · Xingyuan Li, JinYuan Liu, Yixin Lei, Long Ma 외

3D object detection plays a crucial role in numerous intelligent vision systems. Detection in the open world inevitably encounters various adverse scenes, such as dense fog, heavy rain, and low light conditions. Although…

3D Object DetectionMonocular 3D Object DetectionObjectobject-detection+1

Semantic Foggy Scene Understanding with Synthetic Data

2017-08-25 · Christos Sakaridis, Dengxin Dai, Luc van Gool

This work addresses the problem of semantic foggy scene understanding (SFSU). Although extensive research has been performed on image dehazing and on semantic scene understanding with clear-weather images, little attenti…

Image Dehazingobject-detectionObject DetectionScene Understanding+1

Defogging Kinect: Simultaneous Estimation of Object Region and Depth in Foggy Scenes

2019-04-01 · Yuki Fujimura, Motoharu Sonogashira, Masaaki Iiyama

Three-dimensional (3D) reconstruction and scene depth estimation from 2-dimensional (2D) images are major tasks in computer vision. However, using conventional 3D reconstruction techniques gets challenging in participati…

3D ReconstructionDepth EstimationObject

FoggyStereo: Stereo Matching With Fog Volume Representation

2022-01-01 · CVPR 2022 1 · Chengtang Yao, Lidong Yu

Stereo matching in foggy scenes is challenging as the scattering effect of fog blurs the image and makes the matching ambiguous. Prior methods deem the fog as noise and discard it before matching. Different from them…

Stereo Matching