EHGCN: Hierarchical Euclidean-Hyperbolic Fusion via Motion-Aware GCN for Hybrid Event Stream Perception
Event cameras, characterized by microsecond temporal resolution and very High Dynamic Range (HDR), emit high-speed event streams for perception tasks. In recent advancements, Graph Neural Networks (GNNs)-based methods show great potential in event perception. However, they typically rely on straightforward pairwise node connectivity in Euclidean space where they struggle to capture long-range dependencies and faithfully characterize the inherent hierarchical structures of event streams. To this end, we propose EHGCN, a dual-space event perception approach that, to the best of our knowledge, is the first to jointly model event streams in Euclidean and hyperbolic spaces. By introducing hyperbolic geometry into event stream perception, EHGCN enables to naturally capture the anisotropic and hierarchical structures of non-uniform, motion-driven event streams. Specifically, we first introduce a distribution-aware event sifting method based on multi-scale voxel grids and Gaussian distribution modeling, retaining discriminative events while attenuating chaotic noise. Then, we present a Markov Random Field (MRF)-optimized motion-aware hyperedge generation scheme, which minimizes a motion consistency energy function to explicitly capture consistent global motion patterns within short time intervals, thereby eliminating cross-target spurious associations and providing critically topological priors while capturing long-range dependencies among events. Finally, we propose a Euclidean-hyperbolic GCN to fuse the retinal events densely aggregated and hierarchically modeled in local Euclidean and global hyperbolic spaces, respectively, to achieve a hybrid event perception. Extensive experimental results on event perception tasks, such as object detection and recognition, show the effectiveness of our approach. Our code will be released for public use at https://github.com/ev-lluo/EHGCN.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Hyperbolic Graph Diffusion Model
Diffusion generative models (DMs) have achieved promising results in image and graph generation. However, real-world graphs, such as social networks, molecular graphs, and traffic graphs, generally share non-Euclidean to…
Graph GenerationmodelHyperbolic Space Learning Method Leveraging Temporal Motion Priors for Human Mesh Recovery
3D human meshes show a natural hierarchical structure (like torso-limbs-fingers). But existing video-based 3D human mesh recovery methods usually learn mesh features in Euclidean space. It's hard to catch this hierarchic…
Human Mesh RecoveryHEEGNet: Hyperbolic Embeddings for EEG
Electroencephalography (EEG)-based brain-computer interfaces facilitate direct communication with a computer, enabling promising applications in human-computer interactions. However, their utility is currently limited be…
Emotion RecognitionDomain AdaptationEeg DecodingEEG-Based Multimodal Learning via Hyperbolic Mixture-of-Curvature Experts
Electroencephalography (EEG)-based multimodal learning integrates brain signals with complementary modalities to improve mental state assessment, providing great clinical potential. The effectiveness of such paradigms la…
Representation LearningEmotion RecognitionHVT: A Comprehensive Vision Framework for Learning in Non-Euclidean Space
Data representation in non-Euclidean spaces has proven effective for capturing hierarchical and complex relationships in real-world datasets. Hyperbolic spaces, in particular, provide efficient embeddings for hierarchica…
image-classificationImage Classification