Real-time clustering and multi-target tracking using event-based sensors
Clustering is crucial for many computer vision applications such as robust tracking, object detection and segmentation. This work presents a real-time clustering technique that takes advantage of the unique properties of event-based vision sensors. Since event-based sensors trigger events only when the intensity changes, the data is sparse, with low redundancy. Thus, our approach redefines the well-known mean-shift clustering method using asynchronous events instead of conventional frames. The potential of our approach is demonstrated in a multi-target tracking application using Kalman filters to smooth the trajectories. We evaluated our method on an existing dataset with patterns of different shapes and speeds, and a new dataset that we collected. The sensor was attached to the Baxter robot in an eye-in-hand setup monitoring real-world objects in an action manipulation task. Clustering accuracy achieved an F-measure of 0.95, reducing the computational cost by 88% compared to the frame-based method. The average error for tracking was 2.5 pixels and the clustering achieved a consistent number of clusters along time.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringEvent-based visionobject-detectionObject DetectionSimilar Papers 제목 키워드 기반
Advanced Millimeter-Wave Radar System for Real-Time Multiple-Human Tracking and Fall Detection
This study explored an indoor system for tracking multiple humans and detecting falls, employing three Millimeter-Wave radars from Texas Instruments. Compared to wearables and camera methods, Millimeter-Wave radar is not…
ClusteringThe Greedy Dirichlet Process Filter - An Online Clustering Multi-Target Tracker
Reliable collision avoidance is one of the main requirements for autonomous driving. Hence, it is important to correctly estimate the states of an unknown number of static and dynamic objects in real-time. Here, data ass…
Autonomous DrivingClusteringCollision AvoidanceOnline ClusteringMulti-tracklet Tracking for Generic Targets with Adaptive Detection Clustering
Tracking specific targets, such as pedestrians and vehicles, has been the focus of recent vision-based multitarget tracking studies. However, in some real-world scenarios, unseen categories often challenge existing metho…
Multiple Object TrackingOnline Clustering-based Multi-Camera Vehicle Tracking in Scenarios with overlapping FOVs
Multi-Target Multi-Camera (MTMC) vehicle tracking is an essential task of visual traffic monitoring, one of the main research fields of Intelligent Transportation Systems. Several offline approaches have been proposed to…
ClusteringOnline ClusteringState EstimationTransformer Based Multi-Target Bernoulli Tracking for Maritime Radar
Multi-target tracking in the maritime domain is a challenging problem due to the non-Gaussian and fluctuating characteristics of sea clutter. This article investigates the use of machine learning (ML) to the detection an…