paper-with-me

홈 › Papers

Enhancing 2D Representation Learning with a 3D Prior

2024-06-04 · Mehmet Aygün, Prithviraj Dhar, Zhicheng Yan, Oisin Mac Aodha, Rakesh Ranjan

Learning robust and effective representations of visual data is a fundamental task in computer vision. Traditionally, this is achieved by training models with labeled data which can be expensive to obtain. Self-supervised learning attempts to circumvent the requirement for labeled data by learning representations from raw unlabeled visual data alone. However, unlike humans who obtain rich 3D information from their binocular vision and through motion, the majority of current self-supervised methods are tasked with learning from monocular 2D image collections. This is noteworthy as it has been demonstrated that shape-centric visual processing is more robust compared to texture-biased automated methods. Inspired by this, we propose a new approach for strengthening existing self-supervised methods by explicitly enforcing a strong 3D structural prior directly into the model during training. Through experiments, across a range of datasets, we demonstrate that our 3D aware representations are more robust compared to conventional self-supervised baselines.

📄 PDF Abstract BibTeX arXiv:2406.02535

Code (0)

등록된 구현이 없습니다.

Tasks

Representation LearningSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

Similar Papers 제목 키워드 기반

Prior Knowledge Representation for Self-Attention Networks

2021-01-01 · Kehai Chen, Rui Wang, Masao Utiyama, Eiichiro Sumita

Self-attention networks (SANs) have shown promising empirical results in various natural language processing tasks. Typically, it gradually learning language knowledge on the whole training dataset in parallel and stacke…

Translation

NC-SDF: Enhancing Indoor Scene Reconstruction Using Neural SDFs with View-Dependent Normal Compensation

2024-05-01 · CVPR 2024 1 · Ziyi Chen, Xiaolong Wu, Yu Zhang

State-of-the-art neural implicit surface representations have achieved impressive results in indoor scene reconstruction by incorporating monocular geometric priors as additional supervision. However, we have observed th…

3D ReconstructionIndoor Scene Reconstruction

SEMPAI: a Self-Enhancing Multi-Photon Artificial Intelligence for prior-informed assessment of muscle function and pathology

2022-10-28 · Alexander Mühlberg, Paul Ritter, Simon Langer, Chloë Goossens 외

Deep learning (DL) shows notable success in biomedical studies. However, most DL algorithms work as a black box, exclude biomedical experts, and need extensive data. We introduce the Self-Enhancing Multi-Photon Artificia…

Meta-Learning

MUSE: Integrating Multi-Knowledge for Knowledge Graph Completion

2024-09-26 · Pengjie Liu

Knowledge Graph Completion (KGC) aims to predict the missing [relation] part of (head entity)--[relation]->(tail entity) triplet. Most existing KGC methods focus on single features (e.g., relation types) or sub-graph agg…

Knowledge Graph CompletionRelationRelation PredictionRepresentation Learning+1

Enhancing LiDAR Point Features with Foundation Model Priors for 3D Object Detection

2025-07-18 · Yujian Mo, Yan Wu, Junqiao Zhao, Jijun Wang 외 arxiv

Recent advances in foundation models have opened up new possibilities for enhancing 3D perception. In particular, DepthAnything offers dense and reliable geometric priors from monocular RGB images, which can complement s…

3D Object DetectionAutonomous Driving