Picture: A Probabilistic Programming Language for Scene Perception
Recent progress on probabilistic modeling and statistical learning, coupled with the availability of large training datasets, has led to remarkable progress in computer vision. Generative probabilistic models, or analysis-by-synthesis approaches, can capture rich scene structure but have been less widely applied than their discriminative counterparts, as they often require considerable problem-specific engineering in modeling and inference, and inference is typically seen as requiring slow, hypothesize-and-test Monte Carlo methods. Here we present Picture, a probabilistic programming language for scene understanding that allows researchers to express complex generative vision models, while automatically solving them using fast general-purpose inference machinery. Picture provides a stochastic scene language that can express generative models for arbitrary 2D/3D scenes, as well as a hierarchy of representation layers for comparing scene hypotheses with observed images by matching not simply pixels, but also more abstract features (e.g., contours, deep neural network activations). Inference can flexibly integrate advanced Monte Carlo strategies with fast bottom-up data-driven methods. Thus both representations and inference strategies can build directly on progress in discriminatively trained systems to make generative vision more robust and efficient. We use Picture to write programs for 3D face analysis, 3D human pose estimation, and 3D object reconstruction - each competitive with specially engineered baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
3D Human Pose Estimation3D Object ReconstructionObject ReconstructionPose EstimationProbabilistic ProgrammingScene UnderstandingSimilar Papers 제목 키워드 기반
Scenic: A Language for Scenario Specification and Scene Generation
We propose a new probabilistic programming language for the design and analysis of perception systems, especially those based on machine learning. Specifically, we consider the problems of training a perception system to…
Probabilistic ProgrammingScene GenerationSynthetic Data GenerationDesigning Perceptual Puzzles by Differentiating Probabilistic Programs
We design new visual illusions by finding "adversarial examples" for principled models of human perception -- specifically, for probabilistic models, which treat vision as Bayesian inference. To perform this search effic…
Bayesian InferenceColor ConstancyProbabilistic ProgrammingScenic: A Language for Scenario Specification and Data Generation
We propose a new probabilistic programming language for the design and analysis of cyber-physical systems, especially those based on machine learning. Specifically, we consider the problems of training a system to be rob…
Probabilistic ProgrammingSynthetic Data GenerationA Programmatic and Semantic Approach to Explaining and DebuggingNeural Network Based Object Detectors
Even as deep neural networks have become very effective for tasks in vision and perception, it remains difficult to explain and debug their behavior. In this paper, we present a programmatic and semantic approach to expl…
Probabilistic ProgrammingIntelligent Painter: Picture Composition With Resampling Diffusion Model
Have you ever thought that you can be an intelligent painter? This means that you can paint a picture with a few expected objects in mind, or with a desirable scene. This is different from normal inpainting approaches fo…
DenoisingImage Quality Assessmentmodel