paper-with-me

Papers

Offline Tracking with Object Permanence

2023-10-02 · Xianzhong Liu, Holger Caesar

To reduce the expensive labor cost for manual labeling autonomous driving datasets, an alternative is to automatically label the datasets using an offline perception system. However, objects might be temporally occluded. Such occlusion scenarios in the datasets are common yet underexplored in offline auto labeling. In this work, we propose an offline tracking model that focuses on occluded object tracks. It leverages the concept of object permanence which means objects continue to exist even if they are not observed anymore. The model contains three parts: a standard online tracker, a re-identification (Re-ID) module that associates tracklets before and after occlusion, and a track completion module that completes the fragmented tracks. The Re-ID module and the track completion module use the vectorized map as one of the inputs to refine the tracking results with occlusion. The model can effectively recover the occluded object trajectories. It achieves state-of-the-art performance in 3D multi-object tracking by significantly improving the original online tracking result, showing its potential to be applied in offline auto labeling as a useful plugin to improve tracking by recovering occlusions.

📄 PDF Abstract BibTeX arXiv:2310.01288

Code (1)

tudelft-iv-students/offline-tracking-with-object-permanence 공식 구현 pytorch

Tasks

3D Multi-Object TrackingAutonomous DrivingMulti-Object TrackingObjectObject Tracking

Similar Papers 제목 키워드 기반

Symbol and Communicative Grounding through Object Permanence with a Mobile Robot

2022-09-01 · SIGDIAL (ACL) 2022 9 · Josue Torres-Foncesca, Catherine Henry, Casey Kennington

Object permanence is the ability to form and recall mental representations of objects even when they are not in view. Despite being a crucial developmental step for children, object permanence has had only some explorati…

ObjectSpoken Dialogue Systems

Detecting Invisible People

2020-12-15 · ICCV 2021 10 · Tarasha Khurana, Achal Dave, Deva Ramanan

Monocular object detection and tracking have improved drastically in recent years, but rely on a key assumption: that objects are visible to the camera. Many offline tracking approaches reason about occluded objects post…

Depth EstimationMonocular Depth EstimationObjectobject-detection+2

Learning Object Permanence from Videos via Latent Imaginations

2023-10-16 · Manuel Traub, Frederic Becker, Sebastian Otte, Martin V. Butz

While human infants exhibit knowledge about object permanence from two months of age onwards, deep-learning approaches still largely fail to recognize objects' continued existence. We introduce a slot-based autoregressiv…

ObjectRepresentation Learning

Learning to Track with Object Permanence

2021-03-26 · ICCV 2021 10 · Pavel Tokmakov, Jie Li, Wolfram Burgard, Adrien Gaidon

Tracking by detection, the dominant approach for online multi-object tracking, alternates between localization and association steps. As a result, it strongly depends on the quality of instantaneous observations, often f…

Multi-Object TrackingObjectobject-detectionObject Detection+2

Object permanence in newborn chicks is robust against opposing evidence

2024-02-22 · Justin N. Wood, Tomer D. Ullman, Brian W. Wood, Elizabeth S. Spelke 외

Newborn animals have advanced perceptual skills at birth, but the nature of this initial knowledge is unknown. Is initial knowledge flexible, continuously adapting to the statistics of experience? Or can initial knowledg…

Object