Prediction of Scene Plausibility
Understanding the 3D world from 2D images involves more than detection and segmentation of the objects within the scene. It also includes the interpretation of the structure and arrangement of the scene elements. Such understanding is often rooted in recognizing the physical world and its limitations, and in prior knowledge as to how similar typical scenes are arranged. In this research we pose a new challenge for neural network (or other) scene understanding algorithms - can they distinguish between plausible and implausible scenes? Plausibility can be defined both in terms of physical properties and in terms of functional and typical arrangements. Hence, we define plausibility as the probability of encountering a given scene in the real physical world. We build a dataset of synthetic images containing both plausible and implausible scenes, and test the success of various vision models in the task of recognizing and understanding plausibility.
Code (0)
등록된 구현이 없습니다.
Tasks
PredictionScene UnderstandingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Long-term Traffic Scene Prediction via Polynomial Representations in Autonomous Driving
This thesis addresses fundamental challenges in traffic scene prediction for autonomous driving by introducing robust and computationally efficient models based on polynomial representations. While conventional sequence-…
Computational EfficiencyAutonomous DrivingScene GenerationEmbodied Language Grounding with 3D Visual Feature Representations
We propose associating language utterances to 3D visual abstractions of the scene they describe. The 3D visual abstractions are encoded as 3-dimensional visual feature maps. We infer these 3D visual scene feature maps fr…
Object DetectionEP-Diffuser: An Efficient Diffusion Model for Traffic Scene Generation and Prediction via Polynomial Representations
As the prediction horizon increases, predicting the future evolution of traffic scenes becomes increasingly difficult due to the multi-modal nature of agent motion. Most state-of-the-art (SotA) prediction models primaril…
Autonomous VehiclesScene GenerationScene Synthesis from Human Motion
Large-scale capture of human motion with diverse, complex scenes, while immensely useful, is often considered prohibitively costly. Meanwhile, human motion alone contains rich information about the scene they reside in a…
2D Semantic Segmentation task 1 (8 classes)3D Semantic Scene CompletionIndoor Scene SynthesisJACoP: Joint Alignment for Compliant Multi-Agent Prediction
Stochastic Human Trajectory Prediction (HTP) using generative modeling has emerged as a significant area of research. Although state-of-the-art models excel in optimizing the accuracy of individual agents, they often str…
Trajectory Prediction