paper-with-me

Papers

Dual-Granularity Semantic Guided Sparse Routing Diffusion Model for General Pansharpening

2025-01-01 · CVPR 2025 1 · Yinghui Xing, Litao Qu, Shizhou Zhang, Di Xu, Yingkun Yang, Yanning Zhang

Pansharpening aims at integrating complementary information from panchromatic and multispectral images. Available deep-learning based pansharpening methods typically perform exceptionally with particular satellite datasets. At the same time, it has been observed that these models also exhibit scene dependence, for example, if the majority of the training samples come from the urban scenes, the model's performance may decline in the river scene. To address the domain gap produced by varying satellite sensors and distinct scenes, we propose a dual-granularity semantic guided sparse routing diffusion model for general pansharpening. By utilizing the large Vision-Language Models (VLMs) in the field of geoscience, e.g, GeoChat, we introduce the dual granularity semantics to generate dynamic sparse routing scores for adaptation of different satellite sensors and scenes. This scene-level and region-level dual-granularity semantic information serves as guidance for dynamically activating specialized experts within the diffusion model. Extensive experiments on WorldView-3, QuickBird, and GaoFen-2 datasets show the effectiveness of our proposed method. Notably, the proposed method outperforms the comparison approaches in adapting to new satellite sensors and scenes. The codes are available at https://github.com/codgodtao/SGDiff.

📄 PDF Abstract BibTeX

Code (1)

codgodtao/sgdiff 공식 구현 pytorch

Tasks

Pansharpening

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

StructuredDNA: A Bio-Physical Framework for Energy-Aware Transformer Routing

2025-12-01 · Mustapha Hamdi arxiv

The rapid scaling of large computational models has led to a critical increase in energy and compute costs. Inspired by biological systems where structure and function emerge from low-energy configurations, we introduce …

TrueMoE: Dual-Routing Mixture of Discriminative Experts for Synthetic Image Detection

2025-09-19 · Laixin Zhang, Shuaibo Li, Wei Ma, Hongbin Zha arxiv

The rapid progress of generative models has made synthetic image detection an increasingly critical task. Most existing approaches attempt to construct a single, universal discriminative space to separate real from fake …

HiSAC: Hierarchical Sparse Activation Compression for Ultra-long Sequence Modeling in Recommenders

2026-02-24 · Kun Yuan, Junyu Bi, Daixuan Cheng, Changfa Wu 외 arxiv

Modern recommender systems leverage ultra-long user behavior sequences to capture dynamic preferences, but end-to-end modeling is infeasible in production due to latency and memory constraints. While summarizing history …

Multi-Head Attention as a Source of Catastrophic Forgetting in MoE Transformers

2026-02-13 · Anrui Chen, Ruijun Huang, Xin Zhang, Fang Dong 외 arxiv

Mixture-of-Experts (MoE) architectures are often considered a natural fit for continual learning because sparse routing should localize updates and reduce interference, yet MoE Transformers still forget substantially eve…

Continual Learning

MedMix: Specialization-Consistent Federated Sparse MoEs under Modality Heterogeneity

2026-08-14 · Adiba Orzikulova, Dong Min Kim, Jaehong Yoon, Sung-Ju Lee arxiv

Federated multimodal medical AI faces modality heterogeneity at both the client and sample levels: clients may systematically lack access to specific modality types, while individual records within the same client may co…

Federated Learning