Masks and Boxes: Combining the Best of Both Worlds for Multi-Object Tracking
Multi-object tracking (MOT) involves identifying and consistently tracking objects across video sequences. Traditional tracking-by-detection methods, while effective, often require extensive tuning and lack generalizability. On the other hand, segmentation mask-based methods are more generic but struggle with tracking management, making them unsuitable for MOT. We propose a novel approach, McByte, which incorporates a temporally propagated segmentation mask as a strong association cue within a tracking-by-detection framework. By combining bounding box and mask information, McByte enhances robustness and generalizability without per-sequence tuning. Evaluated on four benchmark datasets - DanceTrack, MOT17, SoccerNet-tracking 2022, and KITTI-tracking - McByte demonstrates performance gain in all cases examined. At the same time, it outperforms existing mask-based methods. Implementation code will be provided upon acceptance.
Code (0)
등록된 구현이 없습니다.
Tasks
Hand SegmentationManagementMulti-Object TrackingObject TrackingSegmentationSimilar Papers 제목 키워드 기반
Detection, Pose Estimation and Segmentation for Multiple Bodies: Closing the Virtuous Circle
Human pose estimation methods work well on separated people but struggle with multi-body scenarios. Recent work has addressed this problem by conditioning pose estimation with detected bounding boxes or bottom-up-estimat…
Human Instance SegmentationPose-Based Human Instance SegmentationPose EstimationSegmentationCombining the Best of Two Worlds: A Hybrid Approach to Multilingual Coreference Resolution
Detector Algorithms of Bounding Box and Segmentation Mask of a Mask R-CNN Model
Detection performances on bounding box and segmentation mask outputs of Mask R-CNN models are evaluated. There are significant differences in detection performances of bounding boxes and segmentation masks, where the for…
SegmentationRobust pricing and hedging via neural SDEs
Mathematical modelling is ubiquitous in the financial industry and drives key decision processes. Any given model provides only a crude approximation to reality and the risk of using an inadequate model is hard to detect…
Model SelectionLevelSet R-CNN: A Deep Variational Method for Instance Segmentation
Obtaining precise instance segmentation masks is of high importance in many modern applications such as robotic manipulation and autonomous driving. Currently, many state of the art models are based on the Mask R-CNN fra…
Autonomous DrivingInstance SegmentationSegmentationSemantic Segmentation