paper-with-me

Papers

IDET: Iterative Difference-Enhanced Transformers for High-Quality Change Detection

2022-07-15 · Qing Guo, Ruofei Wang, Rui Huang, Shuifa Sun, Yuxiang Zhang

Change detection (CD) aims to detect change regions within an image pair captured at different times, playing a significant role in diverse real-world applications. Nevertheless, most of the existing works focus on designing advanced network architectures to map the feature difference to the final change map while ignoring the influence of the quality of the feature difference. In this paper, we study the CD from a different perspective, i.e., how to optimize the feature difference to highlight changes and suppress unchanged regions, and propose a novel module denoted as iterative difference-enhanced transformers (IDET). IDET contains three transformers: two transformers for extracting the long-range information of the two images and one transformer for enhancing the feature difference. In contrast to the previous transformers, the third transformer takes the outputs of the first two transformers to guide the enhancement of the feature difference iteratively. To achieve more effective refinement, we further propose the multi-scale IDET-based change detection that uses multi-scale representations of the images for multiple feature difference refinements and proposes a coarse-to-fine fusion strategy to combine all refinements. Our final CD method outperforms seven state-of-the-art methods on six large-scale datasets under diverse application scenarios, which demonstrates the importance of feature difference enhancements and the effectiveness of IDET.

📄 PDF Abstract BibTeX arXiv:2207.09240

Code (1)

rfww/IDET 공식 구현 pytorch

Tasks

Change DetectionVocal Bursts Intensity Prediction

Similar Papers 제목 키워드 기반

B'MOJO: Hybrid State Space Realizations of Foundation Models with Eidetic and Fading Memory

2024-07-08 · Luca Zancato, Arjun Seshadri, Yonatan Dukler, Aditya Golatkar 외

We describe a family of architectures to support transductive inference by allowing memory to grow to a finite but a-priori unknown bound while making efficient use of finite resources for inference. Current architecture…

Language ModelingLanguage ModellingMambaState Space Models

A Single-Loop Accelerated Extra-Gradient Difference Algorithm with Improved Complexity Bounds for Constrained Minimax Optimization

2023-09-21 · NeurIPS 2023 11

In this paper, we propose a novel extra-gradient difference acceleration algorithm for solving constrained nonconvex-nonconcave (NC-NC) minimax problems. In particular, we design a new extra-gradient difference step to o…

Offline Two-Player Zero-Sum Markov Games with KL Regularization

2026-05-13 · Claire Chen, Yuheng Zhang, Xinyu Liu, Zixuan Xie 외 arxiv

We study the problem of learning Nash equilibria in offline two-player zero-sum Markov games. While existing approaches often rely on explicit pessimism to address distribution shift, we show that KL regularization alone…

DIFF2: Differential Private Optimization via Gradient Differences for Nonconvex Distributed Learning

2023-02-08 · Tomoya Murata, Taiji Suzuki

Differential private optimization for nonconvex smooth objective is considered. In the previous work, the best known utility bound is $\widetilde O(\sqrt{d}/(n\varepsilon_\mathrm{DP}))$ in terms of the squared full gradi…

BiDet: An Efficient Binarized Object Detector

2020-03-09 · CVPR 2020 6 · Ziwei Wang, Ziyi Wu, Jiwen Lu, Jie zhou

In this paper, we propose a binarized neural network learning method called BiDet for efficient object detection. Conventional network binarization methods directly quantize the weights and activations in one-stage or tw…

BinarizationObjectobject-detectionObject Detection