Lifelong-MonoDepth: Lifelong Learning for Multi-Domain Monocular Metric Depth Estimation
With the rapid advancements in autonomous driving and robot navigation, there is a growing demand for lifelong learning models capable of estimating metric (absolute) depth. Lifelong learning approaches potentially offer significant cost savings in terms of model training, data storage, and collection. However, the quality of RGB images and depth maps is sensor-dependent, and depth maps in the real world exhibit domain-specific characteristics, leading to variations in depth ranges. These challenges limit existing methods to lifelong learning scenarios with small domain gaps and relative depth map estimation. To facilitate lifelong metric depth learning, we identify three crucial technical challenges that require attention: i) developing a model capable of addressing the depth scale variation through scale-aware depth learning, ii) devising an effective learning strategy to handle significant domain gaps, and iii) creating an automated solution for domain-aware depth inference in practical applications. Based on the aforementioned considerations, in this paper, we present i) a lightweight multi-head framework that effectively tackles the depth scale imbalance, ii) an uncertainty-aware lifelong learning solution that adeptly handles significant domain gaps, and iii) an online domain-specific predictor selection method for real-time inference. Through extensive numerical studies, we show that the proposed method can achieve good efficiency, stability, and plasticity, leading the benchmarks by 8% to 15%.
Code (1)
Tasks
Autonomous DrivingDepth EstimationDepth PredictionLifelong learningMonocular Depth EstimationRobot NavigationSimilar Papers 제목 키워드 기반
Cross Domain LifeLong Sequential Modeling for Online Click-Through Rate Prediction
Deep neural networks (DNNs) that incorporated lifelong sequential modeling (LSM) have brought great success to recommendation systems in various social media platforms. While continuous improvements have been made in dom…
Click-Through Rate PredictionPredictionRecommendation SystemsReactive Exploration to Cope with Non-Stationarity in Lifelong Reinforcement Learning
In lifelong learning, an agent learns throughout its entire life without resets, in a constantly changing environment, as we humans do. Consequently, lifelong learning comes with a plethora of research problems such as c…
Lifelong learningPolicy Gradient MethodsQ-Learningreinforcement-learning+1Lifelong Continual Learning for Anomaly Detection: New Challenges, Perspectives, and Insights
Anomaly detection is of paramount importance in many real-world domains, characterized by evolving behavior. Lifelong learning represents an emerging trend, answering the need for machine learning models that continuousl…
Anomaly DetectionContinual LearningLifelong learningLifelong Learning of Factored Policies via Policy Gradients
Policy gradient methods have shown success in learning continuous control policies for high-dimensional dynamical systems. A major downside of such methods is the amount of exploration they require before yielding high-p…
continuous-controlContinuous ControlLifelong learningPolicy Gradient MethodsLifelong Policy Gradient Learning of Factored Policies for Faster Training Without Forgetting
Policy gradient methods have shown success in learning control policies for high-dimensional dynamical systems. Their biggest downside is the amount of exploration they require before yielding high-performing policies. I…
Lifelong learningPolicy Gradient Methods