paper-with-me

Papers

DGSSM: Diffusion guided state-space models for multimodal salient object detection

2026-04-19 · Suklav Ghosh, Arijit Sur, Pinaki Mitra arxiv

Salient object detection (SOD) requires modeling both long-range contextual dependencies and fine-grained structural details, which remains challenging for convolutional, transformer-based, and Mamba-based state space models. While recent Mamba-based state space approaches enable efficient global reasoning, they often struggle to recover precise object boundaries. In contrast, diffusion models capture strong structural priors through iterative denoising, but their use in discriminative dense prediction is still limited due to computational cost and integration challenges. In this work, we propose DGSSM, a diffusion-guided state space (Mamba) framework that formulates multimodal salient object detection as a progressive denoising process. The framework integrates diffusion structural priors with multi-scale state space encoding, adaptive saliency prompting, and an iterative Mamba diffusion refinement mechanism to improve boundary accuracy. A boundary-aware refinement head and self-distillation strategy further enhance spatial coherence and feature consistency. Extensive experiments on 13 public benchmarks across RGB, RGB-D, and RGB-T settings demonstrate that DGSSM consistently outperforms state-of-the-art methods across multiple evaluation metrics while maintaining a compact model size. These results suggest that diffusion-guided state space modeling is an effective and generalizable paradigm for multimodal dense prediction tasks.

📄 PDF Abstract BibTeX arXiv:2604.17585

Code (0)

등록된 구현이 없습니다.

Tasks

Salient Object Detection

Similar Papers 제목 키워드 기반

MGDT: MLLM-Guided Diffusion Transformer with Relation-Adaptive Mixture-of-Experts for Multimodal Knowledge Graph Completion

2026-07-17 · Xu Hou, Meiyu Liang, Wei Huang, Yawen Li 외 arxiv

Multimodal Knowledge Graph Completion (MKGC) requires inferring missing entities from structural, textual, and visual cues. Existing diffusion-based MKGC methods usually denoise directly on raw multimodal features. Such …

Knowledge Graph Completion

Draw Your Art Dream: Diverse Digital Art Synthesis with Multimodal Guided Diffusion

2022-09-27 · Nisha Huang, Fan Tang, WeiMing Dong, Changsheng Xu

Digital art synthesis is receiving increasing attention in the multimedia community because of engaging the public with art effectively. Current digital art synthesis methods usually use single-modality inputs as guidanc…

Diversity

Diffusion-ES: Gradient-free Planning with Diffusion for Autonomous and Instruction-guided Driving

2024-01-01 · CVPR 2024 1 · Brian Yang, Huangyuan Su, Nikolaos Gkanatsios, Tsung-Wei Ke 외

Diffusion models excel at modeling complex and multimodal trajectory distributions for decision-making and control. Reward-gradient guided denoising has been recently proposed to generate trajectories that maximize b…

Autonomous DrivingDenoisingEfficient Exploration

PlayFusion: Skill Acquisition via Diffusion from Language-Annotated Play

2023-12-07 · Lili Chen, Shikhar Bahl, Deepak Pathak

Learning from unstructured and uncurated data has become the dominant paradigm for generative approaches in language and vision. Such unstructured and unguided behavior data, commonly known as play, is also easier to col…

Denoising

OmniBridge: Unified Multimodal Understanding, Generation, and Retrieval via Latent Space Alignment

2025-09-23 · Teng Xiao, Zuchao Li, Lefei Zhang arxiv

Recent advances in multimodal large language models (LLMs) have led to significant progress in understanding, generation, and retrieval tasks. However, current solutions often treat these tasks in isolation or require tr…

Multimodal Reasoning