paper-with-me

홈 › Papers

Picture: A Probabilistic Programming Language for Scene Perception

2015-06-01 · CVPR 2015 6 · Tejas D. Kulkarni, Pushmeet Kohli, Joshua B. Tenenbaum, Vikash Mansinghka

Recent progress on probabilistic modeling and statistical learning, coupled with the availability of large training datasets, has led to remarkable progress in computer vision. Generative probabilistic models, or analysis-by-synthesis approaches, can capture rich scene structure but have been less widely applied than their discriminative counterparts, as they often require considerable problem-specific engineering in modeling and inference, and inference is typically seen as requiring slow, hypothesize-and-test Monte Carlo methods. Here we present Picture, a probabilistic programming language for scene understanding that allows researchers to express complex generative vision models, while automatically solving them using fast general-purpose inference machinery. Picture provides a stochastic scene language that can express generative models for arbitrary 2D/3D scenes, as well as a hierarchy of representation layers for comparing scene hypotheses with observed images by matching not simply pixels, but also more abstract features (e.g., contours, deep neural network activations). Inference can flexibly integrate advanced Monte Carlo strategies with fast bottom-up data-driven methods. Thus both representations and inference strategies can build directly on progress in discriminatively trained systems to make generative vision more robust and efficient. We use Picture to write programs for 3D face analysis, 3D human pose estimation, and 3D object reconstruction - each competitive with specially engineered baselines.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

3D Human Pose Estimation3D Object ReconstructionObject ReconstructionPose EstimationProbabilistic ProgrammingScene Understanding

Similar Papers 제목 키워드 기반

Scenic: A Language for Scenario Specification and Scene Generation

2018-09-25 · Daniel J. Fremont, Tommaso Dreossi, Shromona Ghosh, Xiangyu Yue 외

We propose a new probabilistic programming language for the design and analysis of perception systems, especially those based on machine learning. Specifically, we consider the problems of training a perception system to…

Probabilistic ProgrammingScene GenerationSynthetic Data Generation

Designing Perceptual Puzzles by Differentiating Probabilistic Programs

2022-04-26 · Kartik Chandra, Tzu-Mao Li, Joshua Tenenbaum, Jonathan Ragan-Kelley

We design new visual illusions by finding "adversarial examples" for principled models of human perception -- specifically, for probabilistic models, which treat vision as Bayesian inference. To perform this search effic…

Bayesian InferenceColor ConstancyProbabilistic Programming

Scenic: A Language for Scenario Specification and Data Generation

2020-10-13 · Daniel J. Fremont, Edward Kim, Tommaso Dreossi, Shromona Ghosh 외

We propose a new probabilistic programming language for the design and analysis of cyber-physical systems, especially those based on machine learning. Specifically, we consider the problems of training a system to be rob…

Probabilistic ProgrammingSynthetic Data Generation

A Programmatic and Semantic Approach to Explaining and DebuggingNeural Network Based Object Detectors

2019-12-01 · Edward Kim, Divya Gopinath, Corina Pasareanu, Sanjit Seshia

Even as deep neural networks have become very effective for tasks in vision and perception, it remains difficult to explain and debug their behavior. In this paper, we present a programmatic and semantic approach to expl…

Probabilistic Programming

Intelligent Painter: Picture Composition With Resampling Diffusion Model

2022-10-31 · Wing-Fung Ku, Wan-Chi Siu, Xi Cheng, H. Anthony Chan

Have you ever thought that you can be an intelligent painter? This means that you can paint a picture with a few expected objects in mind, or with a desirable scene. This is different from normal inpainting approaches fo…

DenoisingImage Quality Assessmentmodel