paper-with-me

Papers

Semi-supervised Multi-task Learning for Semantics and Depth

2021-10-14 · Yufeng Wang, Yi-Hsuan Tsai, Wei-Chih Hung, Wenrui Ding, Shuo Liu, Ming-Hsuan Yang

Multi-Task Learning (MTL) aims to enhance the model generalization by sharing representations between related tasks for better performance. Typical MTL methods are jointly trained with the complete multitude of ground-truths for all tasks simultaneously. However, one single dataset may not contain the annotations for each task of interest. To address this issue, we propose the Semi-supervised Multi-Task Learning (SemiMTL) method to leverage the available supervisory signals from different datasets, particularly for semantic segmentation and depth estimation tasks. To this end, we design an adversarial learning scheme in our semi-supervised training by leveraging unlabeled data to optimize all the task branches simultaneously and accomplish all tasks across datasets with partial annotations. We further present a domain-aware discriminator structure with various alignment formulations to mitigate the domain discrepancy issue among datasets. Finally, we demonstrate the effectiveness of the proposed method to learn across different datasets on challenging street view and remote sensing benchmarks.

📄 PDF Abstract BibTeX arXiv:2110.07197

Code (0)

등록된 구현이 없습니다.

Tasks

Depth EstimationMulti-Task LearningSemantic Segmentation

Similar Papers 제목 키워드 기반

Semantics-Depth-Symbiosis: Deeply Coupled Semi-Supervised Learning of Semantics and Depth

2022-06-21 · Nitin Bansal, Pan Ji, Junsong Yuan, Yi Xu

Multi-task learning (MTL) paradigm focuses on jointly learning two or more tasks, aiming for significant improvement w.r.t model's generalizability, performance, and training/inference memory footprint. The aforementione…

Data AugmentationDepth EstimationMulti-Task LearningSegmentation+1

Semi-Supervised Semantic Depth Estimation using Symbiotic Transformer and NearFarMix Augmentation

2023-08-28 · Md Awsafur Rahman, Shaikh Anowarul Fattah

In computer vision, depth estimation is crucial for domains like robotics, autonomous vehicles, augmented reality, and virtual reality. Integrating semantics with depth enhances scene understanding through reciprocal inf…

Autonomous VehiclesDepth EstimationScene UnderstandingSemantic Segmentation

Geometry meets semantics for semi-supervised monocular depth estimation

2018-10-09 · Pierluigi Zama Ramirez, Matteo Poggi, Fabio Tosi, Stefano Mattoccia 외

Depth estimation from a single image represents a very exciting challenge in computer vision. While other image-based depth sensing techniques leverage on the geometry between different viewpoints (e.g., stereo or struct…

DecoderDepth EstimationDepth PredictionMonocular Depth Estimation+1

DepthMatch: Semi-Supervised RGB-D Scene Parsing through Depth-Guided Regularization

2025-05-26 · Jianxin Huang, Jiahang Li, Sergey Vityazev, Alexander Dvorkovich 외

RGB-D scene parsing methods effectively capture both semantic and geometric features of the environment, demonstrating great potential under challenging conditions such as extreme weather and low lighting. However, exist…

Scene ParsingSemantic Segmentation

XVO: Generalized Visual Odometry via Cross-Modal Self-Training

2023-09-28 · ICCV 2023 1 · Lei Lai, Zhongkai Shangguan, Jimuyang Zhang, Eshed Ohn-Bar

We propose XVO, a semi-supervised learning method for training generalized monocular Visual Odometry (VO) models with robust off-the-self operation across diverse datasets and settings. In contrast to standard monocular …

Monocular Visual OdometryMotion EstimationTransfer LearningVisual Odometry