Mamba in Vision: A Comprehensive Survey of Techniques and Applications
Mamba is emerging as a novel approach to overcome the challenges faced by Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) in computer vision. While CNNs excel at extracting local features, they often struggle to capture long-range dependencies without complex architectural modifications. In contrast, ViTs effectively model global relationships but suffer from high computational costs due to the quadratic complexity of their self-attention mechanisms. Mamba addresses these limitations by leveraging Selective Structured State Space Models to effectively capture long-range dependencies with linear computational complexity. This survey analyzes the unique contributions, computational benefits, and applications of Mamba models while also identifying challenges and potential future research directions. We provide a foundational resource for advancing the understanding and growth of Mamba models in computer vision. An overview of this work is available at https://github.com/maklachur/Mamba-in-Computer-Vision.
Code (1)
Tasks
MambaState Space ModelsSurveyMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Vision Mamba in Remote Sensing: A Comprehensive Survey of Techniques, Applications and Outlook
Deep learning has profoundly transformed remote sensing, yet prevailing architectures like Convolutional Neural Networks (CNNs) and Vision Transformers (ViTs) remain constrained by critical trade-offs: CNNs suffer from l…
BenchmarkingChange DetectionMambaSemantic Segmentation+1Vision Mamba: A Comprehensive Survey and Taxonomy
State Space Model (SSM) is a mathematical model used to describe and analyze the behavior of dynamic systems. This model has witnessed numerous applications in several fields, including control theory, signal processing,…
MambaMedical Image AnalysisState Space ModelsSurvey+2A Survey on Visual Mamba
State space models (SSMs) with selection mechanisms and hardware-aware architectures, namely Mamba, have recently demonstrated significant promise in long-sequence modeling. Since the self-attention mechanism in transfor…
Image RegistrationImage RestorationImage Super-ResolutionMamba+6Visual Mamba: A Survey and New Outlooks
Mamba, a recent selective structured state space model, excels in long sequence modeling, which is vital in the large model era. Long sequence modeling poses significant challenges, including capturing long-range depende…
MambaSurveyA Survey of Mamba
As one of the most representative DL techniques, Transformer architecture has empowered numerous advanced models, especially the large language models (LLMs) that comprise billions of parameters, becoming a cornerstone i…
MambaState Space ModelsSurvey