Long-Term Image Boundary Prediction
Boundary estimation in images and videos has been a very active topic of research, and organizing visual information into boundaries and segments is believed to be a corner stone of visual perception. While prior work has focused on estimating boundaries for observed frames, our work aims at predicting boundaries of future unobserved frames. This requires our model to learn about the fate of boundaries and corresponding motion patterns -- including a notion of "intuitive physics". We experiment on natural video sequences along with synthetic sequences with deterministic physics-based and agent-based motions. While not being our primary goal, we also show that fusion of RGB and boundary prediction leads to improved RGB predictions.
Code (0)
등록된 구현이 없습니다.
Tasks
PredictionSimilar Papers 제목 키워드 기반
Inverse Boundary Value and Optimal Control Problems on Graphs: A Neural and Numerical Synthesis
A general setup for deterministic system identification problems on graphs with Dirichlet and Neumann boundary conditions is introduced. When control nodes are available along the boundary, we apply a discretize-then-opt…
Spatio-Temporal Image Boundary Extrapolation
Boundary prediction in images as well as video has been a very active topic of research and organizing visual information into boundaries and segments is believed to be a corner stone of visual perception. While prior wo…
Video SegmentationVideo Semantic SegmentationPsi-Net: Shape and boundary aware joint multi-task deep network for medical image segmentation
Image segmentation is a primary task in many medical applications. Recently, many deep networks derived from U-Net have been extensively used in various medical image segmentation tasks. However, in most of the cases, ne…
Contour DetectionImage SegmentationMedical Image SegmentationSegmentation+1WaterMask: Instance Segmentation for Underwater Imagery
Underwater image instance segmentation is a fundamental and critical step in underwater image analysis and understanding. However, the paucity of general multiclass instance segmentation datasets has impeded the deve…
2D Object DetectionGraph AttentionInstance SegmentationSegmentation+1Geometry-Aware Anisotropic Boundary Correction for Aerodynamic Simulation
Aerodynamic simulation is a key component of engineering shape design, where core quantities such as the surface pressure coefficient strongly depend on flow dynamics near solid boundaries. Neural operators provide an ef…