paper-with-me

홈 › Papers

Looking Beyond the Visible Scene

2014-06-01 · CVPR 2014 6 · Aditya Khosla, Byoungkwon An An, Joseph J. Lim, Antonio Torralba

A common thread that ties together many prior works in scene understanding is their focus on the aspects directly present in a scene such as its categorical classification or the set of objects. In this work, we propose to look beyond the visible elements of a scene; we demonstrate that a scene is not just a collection of objects and their configuration or the labels assigned to its pixels - it is so much more. From a simple observation of a scene, we can tell a lot about the environment surrounding the scene such as the potential establishments near it, the potential crime rate in the area, or even the economic climate. Here, we explore several of these aspects from both the human perception and computer vision perspective. Specifically, we show that it is possible to predict the distance of surrounding establishments such as McDonald’s or hospitals even by using scenes located far from them. We go a step further to show that both humans and computers perform well at navigating the environment based only on visual cues from scenes. Lastly, we show that it is possible to predict the crime rates in an area simply by looking at a scene without any real-time criminal activity. Simply put, here, we illustrate that it is possible to look beyond the visible scene.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Scene Understanding

Similar Papers 제목 키워드 기반

Separating Invisible Sounds Toward Universal Audiovisual Scene-Aware Sound Separation

2023-10-18 · Yiyang Su, Ali Vosoughi, Shijian Deng, Yapeng Tian 외

The audio-visual sound separation field assumes visible sources in videos, but this excludes invisible sounds beyond the camera's view. Current methods struggle with such sounds lacking visible cues. This paper introduce…

cross-modal alignment

SeGAN: Segmenting and Generating the Invisible

2017-03-29 · CVPR 2018 6 · Kiana Ehsani, Roozbeh Mottaghi, Ali Farhadi

Objects often occlude each other in scenes; Inferring their appearance beyond their visible parts plays an important role in scene understanding, depth estimation, object interaction and manipulation. In this paper, we s…

Depth EstimationScene UnderstandingSegmentation

Multiple-gaze geometry: Inferring novel 3D locations from gazes observed in monocular video

2018-09-01 · ECCV 2018 9 · Ernesto Brau, Jinyan Guan, Tanya Jeffries, Kobus Barnard

We develop using person gaze direction for scene understanding. In particular, we use intersecting gazes to learn 3D locations that people tend to look at, which is analogous to having multiple camera views. The 3D locat…

Scene UnderstandingSmall Data Image Classification

World Tracing: Generative Pixel-Aligned Geometry Beyond the Visible

2026-06-11 · Hao Zhang, Mohamed El Banani, Jen-Hao Cheng, Paul Zhang 외 arxiv

Image-to-3D methods often trade off faithfulness and completeness: depth estimators are anchored to input pixels but stop at the visible surface, while image-to-3D models generate complete shapes that are often misaligne…

3D scene Editing

SRUG: Shadow-Guided Relightable Urban Scene with Generation Model

2026-05-23 · Yonghao Zhao, Zexin Yin, Jian Yang, Beibei Wang 외 arxiv

Creating relightable urban scenes from images or videos is widely useful but highly ill-posed. Urban environments are typically unbounded and extend beyond the visible regions. As a result, many portions of the scene rem…

Novel View Synthesis