Semantic Flow-guided Motion Removal Method for Robust Mapping
Moving objects in scenes are still a severe challenge for the SLAM system. Many efforts have tried to remove the motion regions in the images by detecting moving objects. In this way, the keypoints belonging to motion regions will be ignored in the later calculations. In this paper, we proposed a novel motion removal method, leveraging semantic information and optical flow to extract motion regions. Different from previous works, we don't predict moving objects or motion regions directly from image sequences. We computed rigid optical flow, synthesized by the depth and pose, and compared it against the estimated optical flow to obtain initial motion regions. Then, we utilized K-means to finetune the motion region masks with instance segmentation masks. The ORB-SLAM2 integrated with the proposed motion removal method achieved the best performance in both indoor and outdoor dynamic environments.
Code (0)
등록된 구현이 없습니다.
Tasks
Instance SegmentationOptical Flow EstimationSemantic SegmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Semantic-guided Adversarial Diffusion Model for Self-supervised Shadow Removal
Existing unsupervised methods have addressed the challenges of inconsistent paired data and tedious acquisition of ground-truth labels in shadow removal tasks. However, GAN-based training often faces issues such as mode …
Generative Adversarial NetworkShadow RemovalSemantic-Guided 3D Gaussian Splatting for Transient Object Removal
Transient objects in casual multi-view captures cause ghosting artifacts in 3D Gaussian Splatting (3DGS) reconstruction. Existing solutions relied on scene decomposition at significant memory cost or on motion-based heur…
VTinker: Guided Flow Upsampling and Texture Mapping for High-Resolution Video Frame Interpolation
Due to large pixel movement and high computational cost, estimating the motion of high-resolution frames is challenging. Thus, most flow-based Video Frame Interpolation (VFI) methods first predict bidirectional flows at …
Video Frame InterpolationMovable-Object-Aware Visual SLAM via Weakly Supervised Semantic Segmentation
Moving objects can greatly jeopardize the performance of a visual simultaneous localization and mapping (vSLAM) system which relies on the static-world assumption. Motion removal have seen successful on solving this prob…
SegmentationSemantic SegmentationSimultaneous Localization and MappingWeakly supervised Semantic Segmentation+1Advanced Video Inpainting Using Optical Flow-Guided Efficient Diffusion
Recently, diffusion-based methods have achieved great improvements in the video inpainting task. However, these methods still face many challenges, such as maintaining temporal consistency and the time-consuming issue. T…
DenoisingOptical Flow EstimationVideo Inpainting