paper-with-me

홈 › Papers

End-to-End Unmixing with Material Prompts for Hyperspectral Object Tracking

2026-05-20 · Xu Han, Mohammad Aminul Islam, Lei Wang, Zekun Long, Guanmanyi Fu, Wangshu Cai, Kuldip K. Paliwal, Jun Zhou arxiv

Hyperspectral imagery encodes rich material properties that can improve tracking robustness under appearance ambiguity, illumination change, and background clutter. However, due to the limited availability of hyperspectral video data, many existing methods adapt pretrained RGB trackers via spatial or channel fusion strategies, largely neglecting the intrinsic material information in hyperspectral imagery. Moreover, the few material-aware approaches typically rely on external spectral unmixing pipelines that are decoupled from the tracking objective, limiting effective optimization of material representations for target localization. To address these limitations, we formulate hyperspectral object tracking as a joint optimization problem of material decomposition and target localization, coupling the two tasks via a weighted target-oriented unmixing loss that explicitly aligns material representations with localization accuracy. Specifically, we propose a material representation decomposition module for deep learning-based spectral unmixing with adaptive frequency decomposition. Building on the decomposed material representations, we further introduce a dual-branch wavelet-enhanced material prompt module that learns low- and high-frequency material prompts through efficient spatial-material interactions in the frequency domain. The framework is model-agnostic and can be seamlessly generalized to different unmixing backbones. Extensive experiments on standard hyperspectral tracking benchmarks demonstrate state-of-the-art performance and validate the effectiveness of the proposed end-to-end material-aware tracking framework. Code is available at https://github.com/han030927/E2EMPT.

📄 PDF Abstract BibTeX arXiv:2605.20569

Code (0)

등록된 구현이 없습니다.

Tasks

Object Tracking

Similar Papers 제목 키워드 기반

Hyperspectral Unmixing of Agricultural Images taken from UAV Using Adapted U-Net Architecture

2024-09-29 · Vytautas Paura, Virginijus Marcinkevičius

The hyperspectral unmixing method is an algorithm that extracts material (usually called endmember) data from hyperspectral data cube pixels along with their abundances. Due to a lower spatial resolution of hyperspectral…

Hyperspectral Unmixing

A laboratory-created dataset with ground-truth for hyperspectral unmixing evaluation

2019-02-22 · Min Zhao, Jie Chen, Zhe He

Spectral unmixing is an important and challenging problem in hyperspectral data processing. This topic has been extensively studied and a variety of unmixing algorithms have been proposed in the literature. However, the …

Hyperspectral Unmixing

Spectral Unmixing of Hyperspectral Images Based on Block Sparse Structure

2022-04-10 · Seyed Hossein Mosavi Azarang, Roozbeh Rajabi, Hadi Zayyani, Amin Zehtabian

Spectral unmixing (SU) of hyperspectral images (HSIs) is one of the important areas in remote sensing (RS) that needs to be carefully addressed in different RS applications. Despite the high spectral resolution of the hy…

Hyperspectral Unmixing

Image Processing and Machine Learning for Hyperspectral Unmixing: An Overview and the HySUPP Python Package

2023-08-18 · Behnood Rasti, Alexandre Zouaoui, Julien Mairal, Jocelyn Chanussot

Spectral pixels are often a mixture of the pure spectra of the materials, called endmembers, due to the low spatial resolution of hyperspectral sensors, double scattering, and intimate mixtures of materials in the scenes…

Hyperspectral Unmixing

Dynamical spectral unmixing of multitemporal hyperspectral images

2015-10-14 · Simon Henrot, Jocelyn Chanussot, Christian Jutten

In this paper, we consider the problem of unmixing a time series of hyperspectral images. We propose a dynamical model based on linear mixing processes at each time instant. The spectral signatures and fractional abundan…

Time SeriesTime Series Analysis