paper-with-me

Papers

Mamba Learns in Context: Structure-Aware Domain Generalization for Multi-Task Point Cloud Understanding

2026-03-21 · Jincen Jiang, Qianyu Zhou, Yuhang Li, Kui Su, Meili Wang, Jian Chang, Jian Jun Zhang, Xuequan Lu arxiv

While recent Transformer and Mamba architectures have advanced point cloud representation learning, they are typically developed for single-task or single-domain settings. Directly applying them to multi-task domain generalization (DG) leads to degraded performance. Transformers effectively model global dependencies but suffer from quadratic attention cost and lack explicit structural ordering, whereas Mamba offers linear-time recurrence yet often depends on coordinate-driven serialization, which is sensitive to viewpoint changes and missing regions, causing structural drift and unstable sequential modeling. In this paper, we propose Structure-Aware Domain Generalization (SADG), a Mamba-based In-Context Learning framework that preserves structural hierarchy across domains and tasks. We design structure-aware serialization (SAS) that generates transformation-invariant sequences using centroid-based topology and geodesic curvature continuity. We further devise hierarchical domain-aware modeling (HDM) that stabilizes cross-domain reasoning by consolidating intra-domain structure and fusing inter-domain relations. At test time, we introduce a lightweight spectral graph alignment (SGA) that shifts target features toward source prototypes in the spectral domain without updating model parameters, ensuring structure-preserving test-time feature shifting. In addition, we introduce MP3DObject, a real-scan object dataset for multi-task DG evaluation. Comprehensive experiments demonstrate that the proposed approach improves structural fidelity and consistently outperforms state-of-the-art methods across multiple tasks including reconstruction, denoising, and registration.

📄 PDF Abstract BibTeX arXiv:2603.20739

Code (0)

등록된 구현이 없습니다.

Tasks

Representation LearningDomain Generalization

Similar Papers 제목 키워드 기반

From Markov to Laplace: How Mamba In-Context Learns Markov Chains

2025-02-14 · Marco Bondaschi, Nived Rajaraman, Xiuying Wei, Kannan Ramchandran 외

While transformer-based language models have driven the AI revolution thus far, their computational complexity has spurred growing interest in viable alternatives, such as structured state space sequence models (SSMs) an…

In-Context LearningLanguage ModelingLanguage ModellingMamba

Spatial-Mamba: Effective Visual State Space Models via Structure-Aware State Fusion

2024-10-19 · Chaodong Xiao, Minghan Li, Zhengqiang Zhang, Deyu Meng 외

Selective state space models (SSMs), such as Mamba, highly excel at capturing long-range dependencies in 1D sequential data, while their applications to 2D vision tasks still face challenges. Current visual SSMs often co…

image-classificationImage ClassificationMambaState Space Models

TiM4Rec: An Efficient Sequential Recommendation Model Based on Time-Aware Structured State Space Duality Model

2024-09-24 · Hao Fan, Mengyi Zhu, Yanrong Hu, Hailin Feng 외

The Sequential Recommendation modeling paradigm is shifting from Transformer to Mamba architecture, which comprises two generations: Mamba1, based on the State Space Model (SSM), and Mamba2, based on State Space Duality …

Computational EfficiencyMambamodelRecommendation Systems+1

CAGMamba: Context-Aware Gated Cross-Modal Mamba Network for Multimodal Sentiment Analysis

2026-04-04 · Minghai Jiao, Jing Xiao, Peng Xiao, Ende Zhang 외 arxiv

Multimodal Sentiment Analysis (MSA) requires effective modeling of cross-modal interactions and contextual dependencies while remaining computationally efficient. Existing fusion approaches predominantly rely on Transfor…

Multimodal Sentiment Analysis

SpectralMamba-UNet: Frequency-Disentangled State Space Modeling for Texture-Structure Consistent Medical Image Segmentation

2026-02-26 · Fuhao Zhang, Lei Liu, Jialin Zhang, Ya-Nan Zhang 외 arxiv

Accurate medical image segmentation requires effective modeling of both global anatomical structures and fine-grained boundary details. Recent state space models (e.g., Vision Mamba) offer efficient long-range dependency…

Medical Image Segmentation