Semantic Segmentation for Real-World and Synthetic Vehicle's Forward-Facing Camera Images

2024-07-07 · Tuan T. Nguyen, Phan Le, Yasir Hassan, Mina Sartipi

In this paper, we present the submission to the 5th Annual Smoky Mountains Computational Sciences Data Challenge, Challenge 3. This is the solution for semantic segmentation problem in both real-world and synthetic images from a vehicle s forward-facing camera. We concentrate in building a robust model which performs well across various domains of different outdoor situations such as sunny, snowy, rainy, etc. In particular, our method is developed with two main directions: model development and domain adaptation. In model development, we use the High Resolution Network (HRNet) as the baseline. Then, this baseline s result is processed by two coarse-to-fine models: Object-Contextual Representations (OCR) and Hierarchical Multi-scale Attention (HMA) to get the better robust feature. For domain adaption, we implement the Domain-Based Batch Normalization (DNB) to reduce the distribution shift from diverse domains. Our proposed method yield 81.259 mean intersection-over-union (mIoU) in validation set. This paper studies the effectiveness of employing real-world and synthetic data to handle the domain adaptation in semantic segmentation problem.

📄 PDF Abstract BibTeX arXiv:2407.05452

Code (0)

등록된 구현이 없습니다.

Tasks

Domain Adaptation Optical Character Recognition (OCR)Semantic Segmentation

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Attention 설명 없음

Batch Normalization 설명 없음

Simulation-based reinforcement learning for real-world autonomous driving

2019-11-29 · Błażej Osiński, Adam Jakubowski, Piotr Miłoś, Paweł Zięcina 외

We use reinforcement learning in simulation to obtain a driving system controlling a full-size real-world vehicle. The driving policy takes RGB images from a single camera and their semantic segmentation as input. We use…

Autonomous Driving reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+2

Texture-Shape Bias Balancing for Robust Synthetic-to-Real Semantic Segmentation in Automotive NIR Imagery

2026-06-13 · Felix Stillger, Ben Hamscher, Lukas Hahn, Annika Mütze 외 arxiv

Semantic segmentation is a fundamental component of visual perception in modern automotive systems, enabling pixel-level scene understanding. Near-Infrared imaging (NIR) offers stable detection under difficult illuminati…

Semantic Segmentation Scene Understanding Domain Adaptation

Point Cloud Segmentation of Agricultural Vehicles using 3D Gaussian Splatting

2025-06-05 · Alfred T. Christiansen, Andreas H. Højrup, Morten K. Stephansen, Md Ibtihaj A. Sakib 외

Training neural networks for tasks such as 3D point cloud semantic segmentation demands extensive datasets, yet obtaining and annotating real-world point clouds is costly and labor-intensive. This work aims to introduce …

3DGS Point Cloud Segmentation Semantic Segmentation

Unsupervised Domain Adaptation for Mobile Semantic Segmentation based on Cycle Consistency and Feature Alignment

2020-01-14 · Marco Toldo, Umberto Michieli, Gianluca Agresti, Pietro Zanuttigh

The supervised training of deep networks for semantic segmentation requires a huge amount of labeled real world data. To solve this issue, a commonly exploited workaround is to use synthetic data for training, but deep n…

Autonomous Vehicles Domain Adaptation Segmentation Semantic Segmentation+1

Reimagine BiSeNet for Real-Time Domain Adaptation in Semantic Segmentation

2021-10-22 · Antonio Tavera, Carlo Masone, Barbara Caputo

Semantic segmentation models have reached remarkable performance across various tasks. However, this performance is achieved with extremely large models, using powerful computational resources and without considering tra…

Domain Adaptation Real-Time Semantic Segmentation Segmentation Semantic Segmentation