MOTS: Multi-Object Tracking and Segmentation
This paper extends the popular task of multi-object tracking to multi-object tracking and segmentation (MOTS). Towards this goal, we create dense pixel-level annotations for two existing tracking datasets using a semi-automatic annotation procedure. Our new annotations comprise 65,213 pixel masks for 977 distinct objects (cars and pedestrians) in 10,870 video frames. For evaluation, we extend existing multi-object tracking metrics to this new task. Moreover, we propose a new baseline method which jointly addresses detection, tracking, and segmentation with a single convolutional network. We demonstrate the value of our datasets by achieving improvements in performance when training on MOTS annotations. We believe that our datasets, metrics and baseline will become a valuable resource towards developing multi-object tracking approaches that go beyond 2D bounding boxes. We make our annotations, code, and models available at https://www.vision.rwth-aachen.de/page/mots.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-Object TrackingMulti-Object Tracking and SegmentationMultiple Object TrackingObjectObject TrackingSegmentationSimilar Papers 제목 키워드 기반
Learning Multi-Object Tracking and Segmentation from Automatic Annotations
In this work we contribute a novel pipeline to automatically generate training data, and to improve over state-of-the-art multi-object tracking and segmentation (MOTS) methods. Our proposed track mining algorithm turns r…
Instance SegmentationMulti-Object TrackingMulti-Object Tracking and SegmentationObject+3Assignment-Space-Based Multi-Object Tracking and Segmentation
Multi-object tracking and segmentation (MOTS) is important for understanding dynamic scenes in video data. Existing methods perform well on multi-object detection and segmentation for independent video frames, but tr…
Multi-Object TrackingMulti-Object Tracking and SegmentationObjectobject-detection+3Continuous Copy-Paste for One-Stage Multi-Object Tracking and Segmentation
Current one-step multi-object tracking and segmentation (MOTS) methods lag behind recent two-step methods. By separating the instance segmentation stage from the tracking stage, two-step methods can exploit non-video…
Data AugmentationInstance SegmentationMulti-Object TrackingMulti-Object Tracking and Segmentation+3ReMOTS: Self-Supervised Refining Multi-Object Tracking and Segmentation
We aim to improve the performance of Multiple Object Tracking and Segmentation (MOTS) by refinement. However, it remains challenging for refining MOTS results, which could be attributed to that appearance features are no…
Multi-Object TrackingMulti-Object Tracking and SegmentationMultiple Object TrackingObject+1Segment as Points for Efficient Online Multi-Object Tracking and Segmentation
Current multi-object tracking and segmentation (MOTS) methods follow the tracking-by-detection paradigm and adopt convolutions for feature extraction. However, as affected by the inherent receptive field, convolution bas…
Multi-Object TrackingMulti-Object Tracking and SegmentationObject TrackingOnline Multi-Object Tracking