paper-with-me

홈 › Papers

FreqTrack: Frequency Learning based Vision Transformer for RGB-Event Object Tracking

2026-04-16 · Jinlin You, Muyu Li, Xudong Zhao arxiv

Existing single-modal RGB trackers often face performance bottlenecks in complex dynamic scenes, while the introduction of event sensors offers new potential for enhancing tracking capabilities. However, most current RGB-event fusion methods, primarily designed in the spatial domain using convolutional, Transformer, or Mamba architectures, fail to fully exploit the unique temporal response and high-frequency characteristics of event data. To address this, we1 propose FreqTrack, a frequency-aware RGBE tracking framework that establishes complementary inter-modal correlations through frequency-domain transformations for more robust feature fusion. We design a Spectral Enhancement Transformer (SET) layer that incorporates multi-head dynamic Fourier filtering to adaptively enhance and select frequency-domain features. Additionally, we develop a Wavelet Edge Refinement (WER) module, which leverages learnable wavelet transforms to explicitly extract multi-scale edge structures from event data, effectively improving modeling capability in high-speed and low-light scenarios. Extensive experiments on the COESOT and FE108 datasets demonstrate that FreqTrack achieves highly competitive performance, particularly attaining leading precision of 76.6\% on the COESOT benchmark, validating the effectiveness of frequency-domain modeling for RGBE tracking.

📄 PDF Abstract BibTeX arXiv:2604.14526

Code (0)

등록된 구현이 없습니다.

Tasks

Object Tracking

Results from the Paper

RankTaskDatasetModelMetrics
#13 Object Tracking COESOT FreqTrack Precision Rate: 76.6

Similar Papers 제목 키워드 기반

SpikePool: Event-driven Spiking Transformer with Pooling Attention

2025-10-14 · Donghyun Lee, Alex Sima, Yuhang Li, Panos Stinis 외 arxiv

Building on the success of transformers, Spiking Neural Networks (SNNs) have increasingly been integrated with transformer architectures, leading to spiking transformers that demonstrate promising performance on event-ba…

Event-based visionObject Detection

Spiking Wavelet Transformer

2024-03-17 · Yuetong Fang, Ziqing Wang, Lingfeng Zhang, Jiahang Cao 외

Spiking neural networks (SNNs) offer an energy-efficient alternative to conventional deep learning by emulating the event-driven processing manner of the brain. Incorporating Transformers with SNNs has shown promise for …

Event-based Robotic Grasping Detection with Neuromorphic Vision Sensor and Event-Stream Dataset

2020-04-28 · Bin Li, Hu Cao, Zhongnan Qu, Yingbai Hu 외

Robotic grasping plays an important role in the field of robotics. The current state-of-the-art robotic grasping detection systems are usually built on the conventional vision, such as RGB-D camera. Compared to tradition…

Robotic Grasping

FlexEvent: Towards Flexible Event-Frame Object Detection at Varying Operational Frequencies

2024-12-09 · Dongyue Lu, Lingdong Kong, Gim Hee Lee, Camille Simon Chane 외

Event cameras offer unparalleled advantages for real-time perception in dynamic environments, thanks to the microsecond-level temporal resolution and asynchronous operation. Existing event detectors, however, are limited…

Objectobject-detectionObject Detection

Hierarchical GRU with Input-Conditioned Slot Queries for Ball Action Anticipation

2026-06-02 · Parthsarthi Rawat arxiv

We present a hierarchical model for ball action anticipation in football broadcast video. Given a 30-second observation window, the system predicts actions occurring in the subsequent 5-second window across 10 classes. A…

Action Anticipation