Object-Level Context Modeling For Scene Classification with Context-CNN
Convolutional Neural Networks (CNNs) have been used extensively for computer vision tasks and produce rich feature representation for objects or parts of an image. But reasoning about scenes requires integration between the low-level feature representations and the high-level semantic information. We propose a deep network architecture which models the semantic context of scenes by capturing object-level information. We use Long Short Term Memory(LSTM) units in conjunction with object proposals to incorporate object-object relationship and object-scene relationship in an end-to-end trainable manner. We evaluate our model on the LSUN dataset and achieve results comparable to the state-of-art. We further show visualization of the learned features and analyze the model with experiments to verify our model's ability to model context.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationGeneral ClassificationObjectScene ClassificationSimilar Papers 제목 키워드 기반
Image-Level Attentional Context Modeling Using Nested-Graph Neural Networks
We introduce a new scene graph generation method called image-level attentional context modeling (ILAC). Our model includes an attentional graph network that effectively propagates contextual information across the graph…
Graph GenerationGraph Neural NetworkObjectScene Graph GenerationWhat is (missing or wrong) in the scene? A Hybrid Deep Boltzmann Machine For Contextualized Scene Modeling
Scene models allow robots to reason about what is in the scene, what else should be in it, and what should not be in it. In this paper, we propose a hybrid Boltzmann Machine (BM) for scene modeling where relations betwee…
General ClassificationScene ClassificationSCLARO: A Dataset for Grounded Scenario-Level Scene Understanding and ScenarioCLIP for Benchmarking
In the paradigm of computer vision-based precise real-world scene understanding, joint reasoning in terms of contextual understanding about the objects present in a scene, their inter-object relations, and the action bei…
Knowledge DistillationGraph ClassificationScene UnderstandingObject DetectionIncorporating Scene Context and Object Layout into Appearance Modeling
A scene category imposes tight distributions over the kind of objects that might appear in the scene, the appearance of those objects and their layout. In this paper, we propose a method to learn scene structures that ca…
ObjectScene UnderstandingShallow2Deep: Indoor Scene Modeling by Single Image Understanding
Dense indoor scene modeling from 2D images has been bottlenecked due to the absence of depth information and cluttered occlusions. We present an automatic indoor scene modeling approach using deep features from neural ne…
3D geometryglobal-optimizationRelation NetworkScene Understanding