paper-with-me

홈 › Papers

Learning Temporal 3D Semantic Scene Completion via Optical Flow Guidance

2025-02-20 · Meng Wang, Fan Wu, Ruihui Li, Yunchuan Qin, Zhuo Tang, Kenli Li

3D Semantic Scene Completion (SSC) provides comprehensive scene geometry and semantics for autonomous driving perception, which is crucial for enabling accurate and reliable decision-making. However, existing SSC methods are limited to capturing sparse information from the current frame or naively stacking multi-frame temporal features, thereby failing to acquire effective scene context. These approaches ignore critical motion dynamics and struggle to achieve temporal consistency. To address the above challenges, we propose a novel temporal SSC method FlowScene: Learning Temporal 3D Semantic Scene Completion via Optical Flow Guidance. By leveraging optical flow, FlowScene can integrate motion, different viewpoints, occlusions, and other contextual cues, thereby significantly improving the accuracy of 3D scene completion. Specifically, our framework introduces two key components: (1) a Flow-Guided Temporal Aggregation module that aligns and aggregates temporal features using optical flow, capturing motion-aware context and deformable structures; and (2) an Occlusion-Guided Voxel Refinement module that injects occlusion masks and temporally aggregated features into 3D voxel space, adaptively refining voxel representations for explicit geometric modeling. Experimental results demonstrate that FlowScene achieves state-of-the-art performance on the SemanticKITTI and SSCBench-KITTI-360 benchmarks.

📄 PDF Abstract BibTeX arXiv:2502.14520

Code (0)

등록된 구현이 없습니다.

Tasks

3D Semantic Scene CompletionAutonomous DrivingOptical Flow Estimation

Similar Papers 제목 키워드 기반

CurriFlow: Curriculum-Guided Depth Fusion with Optical Flow-Based Temporal Alignment for 3D Semantic Scene Completion

2025-10-14 · Jinzhou Lin, Jie Zhou, Wenhao Xu, Rongtao Xu 외 arxiv

Semantic Scene Completion (SSC) aims to infer complete 3D geometry and semantics from monocular images, serving as a crucial capability for camera-based perception in autonomous driving. However, existing SSC methods rel…

3D Semantic Scene CompletionAutonomous Driving

Temporally coherent completion of dynamic video

2016-11-01 · J.-B. Huang, S. B. Kang, N. Ahuja, J. Kopf

We present an automatic video completion algorithm that synthesizes missing regions in videos in a temporally coherent fashion. Our algorithm can handle dynamic scenes captured using a moving camera. State-of-the-art app…

Optical Flow EstimationVideo Inpainting

Joint Optical Flow and Temporally Consistent Semantic Segmentation

2016-07-26 · Junhwa Hur, Stefan Roth

The importance and demands of visual scene understanding have been steadily increasing along with the active development of autonomous systems. Consequently, there has been a large amount of research dedicated to semanti…

Motion EstimationOptical Flow EstimationScene UnderstandingSegmentation+1

Bi-FlowGS: Bridging Generative View Completion and Gaussian Geometry through Bidirectional Flow Co-Refinement

2026-09-15 · Yuetong Wang, Jinsheng Quan, Yi Yang, Yawei Luo arxiv

Sparse-view 3D scene reconstruction with 3D Gaussian Splatting (3DGS) is inherently underconstrained. Plausible renderings can also coexist with erroneous Gaussian geometry, as errors in positions or depths may be concea…

Video Restoration

Abstract Flow for Temporal Semantic Segmentation on the Permutohedral Lattice

2022-03-29 · Peer Schütt, Radu Alexandru Rosu, Sven Behnke

Semantic segmentation is a core ability required by autonomous agents, as being able to distinguish which parts of the scene belong to which object class is crucial for navigation and interaction with the environment. Ap…

Optical Flow EstimationSemantic Segmentation