Mesh Mamba: A Unified State Space Model for Saliency Prediction in Non-Textured and Textured Meshes
Mesh saliency enhances the adaptability of 3D vision by identifying and emphasizing regions that naturally attract visual attention. To investigate the interaction between geometric structure and texture in shaping visual attention, we establish a comprehensive mesh saliency dataset, which is the first to systematically capture the differences in saliency distribution under both textured and non-textured visual conditions. Furthermore, we introduce mesh Mamba, a unified saliency prediction model based on a state space model (SSM), designed to adapt across various mesh types. Mesh Mamba effectively analyzes the geometric structure of the mesh while seamlessly incorporating texture features into the topological framework, ensuring coherence throughout appearance-enhanced modeling. More importantly, by subgraph embedding and a bidirectional SSM, the model enables global context modeling for both local geometry and texture, preserving the topological structure and improving the understanding of visual details and structural complexity. Through extensive theoretical and empirical validation, our model not only improves performance across various mesh types but also demonstrates high scalability and versatility, particularly through cross validations of various visual features.
Code (1)
Tasks
MambaSaliency PredictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
MeshMamba: State Space Models for Articulated 3D Mesh Generation and Reconstruction
In this paper, we introduce MeshMamba, a neural network model for learning 3D articulated mesh models by employing the recently proposed Mamba State Space Models (Mamba-SSMs). MeshMamba is efficient and scalable in handl…
Human Mesh RecoverySUM: Saliency Unification through Mamba for Visual Attention Modeling
Visual attention modeling, important for interpreting and prioritizing visual stimuli, plays a significant role in applications such as marketing, multimedia, and robotics. Traditional saliency prediction models, especia…
MambaMarketingSaliency DetectionSaliency PredictionSamba: A Unified Mamba-based Framework for General Salient Object Detection
Existing salient object detection (SOD) models primarily resort to convolutional neural networks (CNNs) and Transformers. However, the limited receptive fields of CNNs and quadratic computational complexity of transf…
Mambaobject-detectionObject DetectionSalient Object DetectionSamba+: General and Accurate Salient Object Detection via A More Unified Mamba-based Framework
Existing salient object detection (SOD) models are generally constrained by the limited receptive fields of convolutional neural networks (CNNs) and quadratic computational complexity of Transformers. Recently, the emerg…
Computational EfficiencySalient Object DetectionContinual LearningMesh Saliency: An Independent Perceptual Measure or a Derivative of Image Saliency?
While mesh saliency aims to predict regional importance of 3D surfaces in agreement with human visual perception and is well researched in computer vision and graphics, latest work with eye-tracking experiments shows…