paper-with-me

홈 › Papers

Non-parametric Memory for Spatio-Temporal Segmentation of Construction Zones for Self-Driving

2021-01-18 · Min Bai, Shenlong Wang, Kelvin Wong, Ersin Yumer, Raquel Urtasun

In this paper, we introduce a non-parametric memory representation for spatio-temporal segmentation that captures the local space and time around an autonomous vehicle (AV). Our representation has three important properties: (i) it remembers what it has seen in the past, (ii) it reinforces and (iii) forgets its past beliefs based on new evidence. Reinforcing is important as the first time we see an element we might be uncertain, e.g, if the element is heavily occluded or at range. Forgetting is desirable, as otherwise false positives will make the self driving vehicle behave erratically. Our process is informed by 3D reasoning, as occlusion is key to distinguishing between the desire to forget and to remember. We show how our method can be used as an online component to complement static world representations such as HD maps by detecting and remembering changes that should be superimposed on top of this static view due to such events.

📄 PDF Abstract BibTeX arXiv:2101.06865

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Hierarchical Spatiotemporal Transformers for Video Object Segmentation

2023-07-17 · Jun-Sang Yoo, Hongjae Lee, Seung-Won Jung

This paper presents a novel framework called HST for semi-supervised video object segmentation (VOS). HST extracts image and video features using the latest Swin Transformer and Video Swin Transformer to inherit their in…

Inductive BiasObjectSemantic SegmentationSemi-Supervised Video Object Segmentation+2

Unsupervised Space-Time Network for Temporally-Consistent Segmentation of Multiple Motions

2023-01-01 · CVPR 2023 1 · Etienne Meunier, Patrick Bouthemy

Motion segmentation is one of the main tasks in computer vision and is relevant for many applications. The optical flow (OF) is the input generally used to segment every frame of a video sequence into regions of cohe…

Motion SegmentationOptical Flow EstimationSegmentation

Multivariate Spatiotemporal Hawkes Processes and Network Reconstruction

2018-11-15 · Baichuan Yuan, Hao Li, Andrea L. Bertozzi, P. Jeffrey Brantingham 외

There is often latent network structure in spatial and temporal data and the tools of network analysis can yield fascinating insights into such data. In this paper, we develop a nonparametric method for network reconstru…

Spatio-temporal video autoencoder with differentiable memory

2015-11-19 · Viorica Patraucean, Ankur Handa, Roberto Cipolla

We describe a new spatio-temporal video autoencoder, based on a classic spatial image autoencoder and a novel nested temporal autoencoder. The temporal encoder is represented by a differentiable visual memory composed of…

DecoderMotion EstimationOptical Flow EstimationSemantic Segmentation+2

Self-Supervised Video Object Segmentation by Motion-Aware Mask Propagation

2021-07-27 · Bo Miao, Mohammed Bennamoun, Yongsheng Gao, Ajmal Mian

We propose a self-supervised spatio-temporal matching method, coined Motion-Aware Mask Propagation (MAMP), for video object segmentation. MAMP leverages the frame reconstruction task for training without the need for ann…

SegmentationSemantic SegmentationSemi-Supervised Video Object SegmentationVideo Object Segmentation+1