OCONet: Image Extrapolation by Object Completion
Image extrapolation extends an input image beyond the originally-captured field of view. Existing methods struggle to extrapolate images with salient objects in the foreground or are limited to very specific objects such as humans, but tend to work well on indoor/outdoor scenes. We introduce OCONet (Object COmpletion Networks) to extrapolate foreground objects, with an object completion network conditioned on its class. OCONet uses an encoder-decoder architecture trained with adversarial loss to predict the object's texture as well as its extent, represented as a predicted signed-distance field. An independent step extends the background, and the object is composited on top using the predicted mask. Both qualitative and quantitative results show that we improve on state-of-the-art image extrapolation results for challenging examples.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderObjectSimilar Papers 제목 키워드 기반
CocoNet: A deep neural network for mapping pixel coordinates to color values
In this paper, we propose a deep neural network approach for mapping the 2D pixel coordinates in an image to the corresponding Red-Green-Blue (RGB) color values. The neural network is termed CocoNet, i.e. coordinates-to-…
DenoisingImage CompressionImage DenoisingImage Completion and Extrapolation with Contextual Cycle Consistency
Image Completion refers to the task of filling in the missing regions of an image and Image Extrapolation refers to the task of extending an image at its boundaries while keeping it coherent. Many recent works based on G…
A Physics-Informed Deep Learning Model for MRI Brain Motion Correction
Background: MRI is crucial for brain imaging but is highly susceptible to motion artifacts due to long acquisition times. This study introduces PI-MoCoNet, a physics-informed motion correction network that integrates spa…
DiagnosticMotion Detectionparameter estimationSSIMCoCoNet: A Collaborative Convolutional Network
We present an end-to-end deep network for fine-grained visual categorization called Collaborative Convolutional Network (CoCoNet). The network uses a collaborative layer after the convolutional layers to represent an ima…
Fine-Grained Visual CategorizationFine-Grained Visual RecognitionTransfer LearningDepth Completion with Twin Surface Extrapolation at Occlusion Boundaries
Depth completion starts from a sparse set of known depth values and estimates the unknown depths for the remaining image pixels. Most methods model this as depth interpolation and erroneously interpolate depth pixels int…
Depth Completion