paper-with-me

홈 › Papers

Contour-guided Image Completion with Perceptual Grouping

2021-11-22 · Morteza Rezanejad, Sidharth Gupta, Chandra Gummaluru, Ryan Marten, John Wilder, Michael Gruninger, Dirk B. Walther

Humans are excellent at perceiving illusory outlines. We are readily able to complete contours, shapes, scenes, and even unseen objects when provided with images that contain broken fragments of a connected appearance. In vision science, this ability is largely explained by perceptual grouping: a foundational set of processes in human vision that describes how separated elements can be grouped. In this paper, we revisit an algorithm called Stochastic Completion Fields (SCFs) that mechanizes a set of such processes -- good continuity, closure, and proximity -- through contour completion. This paper implements a modernized model of the SCF algorithm, and uses it in an image editing framework where we propose novel methods to complete fragmented contours. We show how the SCF algorithm plausibly mimics results in human perception. We use the SCF completed contours as guides for inpainting, and show that our guides improve the performance of state-of-the-art models. Additionally, we show that the SCF aids in finding edges in high-noise environments. Overall, our described algorithms resemble an important mechanism in the human visual system, and offer a novel framework that modern computer vision models can benefit from.

📄 PDF Abstract BibTeX arXiv:2111.11322

Code (1)

sidguptacode/stochastic_completion_fields 공식 구현

Similar Papers 제목 키워드 기반

Perceptual Organization and Recognition of Indoor Scenes from RGB-D Images

2013-06-01 · CVPR 2013 6 · Saurabh Gupta, Pablo Arbelaez, Jitendra Malik

We address the problems of contour detection, bottomup grouping and semantic segmentation using RGB-D data. We focus on the challenging setting of cluttered indoor scenes, and evaluate our approach on the recently introd…

Boundary DetectionContour DetectionObjectObject Recognition+4

Learning compact generalizable neural representations supporting perceptual grouping

2020-06-21 · Vijay Veerabadran, Virginia R. de Sa

Work at the intersection of vision science and deep learning is starting to explore the efficacy of deep convolutional networks (DCNs) and recurrent networks in solving perceptual grouping problems that underlie primate …

PathfinderTransfer Learning

Latent Noise Segmentation: How Neural Noise Leads to the Emergence of Segmentation and Grouping

2023-09-28 · Ben Lonnqvist, Zhengqing Wu, Michael H. Herzog

Humans are able to segment images effortlessly without supervision using perceptual grouping. Here, we propose a counter-intuitive computational approach to solving unsupervised perceptual grouping and segmentation: that…

SegmentationSemantic Segmentation

Grouping Contours Via a Related Image

2008-12-01 · NeurIPS 2008 12 · Praveen Srinivasan, Liming Wang, Jianbo Shi

Contours have been established in the biological and computer vision literatures as a compact yet descriptive representation of object shape. While individual contours provide structure, they lack the large spatial suppo…

Descriptive

Contour Completion by Transformers and Its Application to Vector Font Data

2023-04-27 · Yusuke Nagata, Brian Kenji Iwana, Seiichi Uchida

In documents and graphics, contours are a popular format to describe specific shapes. For example, in the True Type Font (TTF) file format, contours describe vector outlines of typeface shapes. Each contour is often defi…