FreqTrack: Frequency Learning based Vision Transformer for RGB-Event Object Tracking
Existing single-modal RGB trackers often face performance bottlenecks in complex dynamic scenes, while the introduction of event sensors offers new potential for enhancing tracking capabilities. However, most current RGB-event fusion methods, primarily designed in the spatial domain using convolutional, Transformer, or Mamba architectures, fail to fully exploit the unique temporal response and high-frequency characteristics of event data. To address this, we1 propose FreqTrack, a frequency-aware RGBE tracking framework that establishes complementary inter-modal correlations through frequency-domain transformations for more robust feature fusion. We design a Spectral Enhancement Transformer (SET) layer that incorporates multi-head dynamic Fourier filtering to adaptively enhance and select frequency-domain features. Additionally, we develop a Wavelet Edge Refinement (WER) module, which leverages learnable wavelet transforms to explicitly extract multi-scale edge structures from event data, effectively improving modeling capability in high-speed and low-light scenarios. Extensive experiments on the COESOT and FE108 datasets demonstrate that FreqTrack achieves highly competitive performance, particularly attaining leading precision of 76.6\% on the COESOT benchmark, validating the effectiveness of frequency-domain modeling for RGBE tracking.
Code (0)
등록된 구현이 없습니다.
Tasks
Object TrackingResults from the Paper
| Rank | Task | Dataset | Model | Metrics |
|---|---|---|---|---|
| #13 | Object Tracking | COESOT | FreqTrack | Precision Rate: 76.6 |
Similar Papers 제목 키워드 기반
SpikePool: Event-driven Spiking Transformer with Pooling Attention
Building on the success of transformers, Spiking Neural Networks (SNNs) have increasingly been integrated with transformer architectures, leading to spiking transformers that demonstrate promising performance on event-ba…
Event-based visionObject DetectionSpiking Wavelet Transformer
Spiking neural networks (SNNs) offer an energy-efficient alternative to conventional deep learning by emulating the event-driven processing manner of the brain. Incorporating Transformers with SNNs has shown promise for …
Event-based Robotic Grasping Detection with Neuromorphic Vision Sensor and Event-Stream Dataset
Robotic grasping plays an important role in the field of robotics. The current state-of-the-art robotic grasping detection systems are usually built on the conventional vision, such as RGB-D camera. Compared to tradition…
Robotic GraspingFlexEvent: Towards Flexible Event-Frame Object Detection at Varying Operational Frequencies
Event cameras offer unparalleled advantages for real-time perception in dynamic environments, thanks to the microsecond-level temporal resolution and asynchronous operation. Existing event detectors, however, are limited…
Objectobject-detectionObject DetectionHierarchical GRU with Input-Conditioned Slot Queries for Ball Action Anticipation
We present a hierarchical model for ball action anticipation in football broadcast video. Given a 30-second observation window, the system predicts actions occurring in the subsequent 5-second window across 10 classes. A…
Action Anticipation