Joint Supervised and Self-Supervised Learning for 3D Real-World Challenges

2020-04-15 · Antonio Alliegro, Davide Boscaini, Tatiana Tommasi

Point cloud processing and 3D shape understanding are very challenging tasks for which deep learning techniques have demonstrated great potentials. Still further progresses are essential to allow artificial intelligent agents to interact with the real world, where the amount of annotated data may be limited and integrating new sources of knowledge becomes crucial to support autonomous learning. Here we consider several possible scenarios involving synthetic and real-world point clouds where supervised learning fails due to data scarcity and large domain gaps. We propose to enrich standard feature representations by leveraging self-supervision through a multi-task model that can solve a 3D puzzle while learning the main task of shape classification or part segmentation. An extensive analysis investigating few-shot, transfer learning and cross-domain settings shows the effectiveness of our approach with state-of-the-art results for 3D shape classification and part segmentation.

📄 PDF Abstract BibTeX arXiv:2004.07392

Code (0)

등록된 구현이 없습니다.

Tasks

3D Shape Classification General Classification Segmentation Self-Supervised Learning Transfer Learning

Robust Self-Supervised Cross-Modal Super-Resolution against Real-World Misaligned Observations

2026-02-21 · Xiaoyu Dong, Jiahuan Li, Ziteng Cui, Naoto Yokoya arxiv

Cross-modal super-resolution (SR) on real-world misaligned data is challenging, as only unlabeled low-resolution (LR) source and high-resolution (HR) guide images with complex spatial misalignment are available. Previous…

SentimentArcs: A Novel Method for Self-Supervised Sentiment Analysis of Time Series Shows SOTA Transformers Can Struggle Finding Narrative Arcs

2021-10-18 · Jon Chun

SOTA Transformer and DNN short text sentiment classifiers report over 97% accuracy on narrow domains like IMDB movie reviews. Real-world performance is significantly lower because traditional models overfit benchmarks an…

Self-Supervised Learning Sentiment Analysis Time Series Time Series Analysis

Semi-Supervised Disparity Estimation with Deep Feature Reconstruction

2021-06-01 · Julia Guerrero-Viu, Sergio Izquierdo, Philipp Schröppel, Thomas Brox

Despite the success of deep learning in disparity estimation, the domain generalization gap remains an issue. We propose a semi-supervised pipeline that successfully adapts DispNet to a real-world domain by joint supervi…

Disparity Estimation Domain Generalization

AD-L-JEPA: Self-Supervised Spatial World Models with Joint Embedding Predictive Architecture for Autonomous Driving with LiDAR Data

2025-01-09 · Haoran Zhu, Zhenyuan Dong, Kristi Topollai, Anna Choromanska

As opposed to human drivers, current autonomous driving systems still require vast amounts of labeled data to train. Recently, world models have been proposed to simultaneously enhance autonomous driving capabilities by …

3D Object Detection Autonomous Driving Contrastive Learning Transfer Learning

Does Self-supervised Learning Really Improve Reinforcement Learning from Pixels?

2022-06-10 · Xiang Li, Jinghuan Shang, Srijan Das, Michael S. Ryoo

We investigate whether self-supervised learning (SSL) can improve online reinforcement learning (RL) from pixels. We extend the contrastive reinforcement learning framework (e.g., CURL) that jointly optimizes SSL and RL …

Image Augmentation reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)+1