paper-with-me

Papers

Mitigating Positional Leakage in 3D Masked Autoencoders for Robust Representation Learning

2026-06-30 · Xu Yan, Huiqun Wang, Chen Wang, Lei Ren, Di Huang arxiv

Masked autoencoding has emerged as a prominent paradigm for self-supervised learning on 3D point clouds, achieving competitive performance across downstream tasks. Unlike its 2D counterpart, 3D masked autoencoding directly reconstructs spatial coordinates, making it inherently susceptible to positional leakage. In this work, we identify that the decoder in existing 3D MAE frameworks tends to over-rely on positional information, which weakens semantic representation learning and leads to suboptimal feature quality. To address this issue, we propose MPL-MAE, a masked point learning framework that mitigates positional over-reliance while enhancing the utilization of encoder features. Specifically, we introduce a recalibrated positional embedding module that suppresses metric-dominant coordinate signals while preserving geometric topology, together with a gated positional interface module that dynamically regulates positional injection during reconstruction. These designs promote a more balanced interaction between spatial priors and semantic features, yielding robust and informative representations. Extensive experiments across downstream tasks demonstrate that MPL-MAE consistently achieves competitive performance, validating its effectiveness. Code is available at https://github.com/yanx57/MPL-MAE.

📄 PDF Abstract BibTeX arXiv:2606.31570

Code (0)

등록된 구현이 없습니다.

Tasks

Self-Supervised LearningRepresentation LearningPoint Clouds

Similar Papers 제목 키워드 기반

Diffusion Masked Pretraining for Dynamic Point Cloud

2026-05-05 · Zhuoyue Zhang, Jihua Zhu, Chaowei Fang, Jian Liu 외 arxiv

Dynamic point cloud pretraining is still dominated by masked reconstruction objectives. However, these objectives inherit two key limitations. Existing methods inject ground-truth tube centers as decoder positional embed…

Action SegmentationPoint Clouds

Masked Autoencoders As Spatiotemporal Learners

2022-05-18 · Christoph Feichtenhofer, Haoqi Fan, Yanghao Li, Kaiming He

This paper studies a conceptually simple extension of Masked Autoencoders (MAE) to spatiotemporal representation learning from videos. We randomly mask out spacetime patches in videos and learn an autoencoder to reconstr…

Inductive BiasRepresentation Learning

Multi-modal Masked Autoencoders Learn Compositional Histopathological Representations

2022-09-04 · Wisdom Oluchi Ikezogwo, Mehmet Saygin Seyfioglu, Linda Shapiro

Self-supervised learning (SSL) enables learning useful inductive biases through utilizing pretext tasks that require no labels. The unlabeled nature of SSL makes it especially important for whole slide histopathological …

Self-Supervised Learning

Graph Positional Autoencoders as Self-supervised Learners

2025-05-29 · Yang Liu, Deyu Bo, Wenxuan Cao, Yuan Fang 외

Graph self-supervised learning seeks to learn effective graph representations without relying on labeled data. Among various approaches, graph autoencoders (GAEs) have gained significant attention for their efficiency an…

Graph Property PredictionMissing ElementsNode ClassificationProperty Prediction+2

SeRP: Self-Supervised Representation Learning Using Perturbed Point Clouds

2022-09-13 · Siddhant Garg, Mudit Chaudhary

We present SeRP, a framework for Self-Supervised Learning of 3D point clouds. SeRP consists of encoder-decoder architecture that takes perturbed or corrupted point clouds as inputs and aims to reconstruct the original po…

DecoderQuantizationRepresentation LearningSelf-Supervised Learning