paper-with-me

Papers

Semantic-Aware Label Placement for Augmented Reality in Street View

2019-12-15 · Jianqing Jia, Semir Elezovikj, Heng Fan, Shuojin Yang, Jing Liu, Wei Guo, Chiu C. Tan, Haibin Ling

In an augmented reality (AR) application, placing labels in a manner that is clear and readable without occluding the critical information from the real-world can be a challenging problem. This paper introduces a label placement technique for AR used in street view scenarios. We propose a semantic-aware task-specific label placement method by identifying potentially important image regions through a novel feature map, which we refer to as guidance map. Given an input image, its saliency information, semantic information and the task-specific importance prior are integrated into the guidance map for our labeling task. To learn the task prior, we created a label placement dataset with the users' labeling preferences, as well as use it for evaluation. Our solution encodes the constraints for placing labels in an optimization problem to obtain the final label layout, and the labels will be placed in appropriate positions to reduce the chances of overlaying important real-world objects in street view AR scenarios. The experimental validation shows clearly the benefits of our method over previous solutions in the AR street view navigation and similar applications.

📄 PDF Abstract BibTeX arXiv:1912.07105

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

OCTOPUS: Open-vocabulary Content Tracking and Object Placement Using Semantic Understanding in Mixed Reality

2023-12-20 · Luke Yoffe, Aditya Sharma, Tobias Höllerer

One key challenge in augmented reality is the placement of virtual content in natural locations. Existing automated techniques are only able to work with a closed-vocabulary, fixed set of objects. In this paper, we intro…

Mixed RealityObject

OCTO+: A Suite for Automatic Open-Vocabulary Object Placement in Mixed Reality

2024-01-17 · Aditya Sharma, Luke Yoffe, Tobias Höllerer

One key challenge in Augmented Reality is the placement of virtual content in natural locations. Most existing automated techniques can only work with a closed-vocabulary, fixed set of objects. In this paper, we introduc…

Mixed Realityvalid

Task-oriented and Semantics-aware Communications for Augmented Reality

2024-08-01 · Zhe Wang, Yansha Deng

Upon the advent of the emerging metaverse and its related applications in Augmented Reality (AR), the current bit-oriented network struggles to support real-time changes for the vast amount of associated information, cre…

A Novel Visualization System of Using Augmented Reality in Knee Replacement Surgery: Enhanced Bidirectional Maximum Correntropy Algorithm

2021-03-13 · Nitish Maharjan, Abeer Alsadoon, P. W. C. Prasad, Salma Abdullah 외

Background and aim: Image registration and alignment are the main limitations of augmented reality-based knee replacement surgery. This research aims to decrease the registration error, eliminate outcomes that are trappe…

AnatomyImage Registration

MaskFusion: Real-Time Recognition, Tracking and Reconstruction of Multiple Moving Objects

2018-04-24 · Martin Rünz, Maud Buffier, Lourdes Agapito

We present MaskFusion, a real-time, object-aware, semantic and dynamic RGB-D SLAM system that goes beyond traditional systems which output a purely geometric map of a static scene. MaskFusion recognizes, segments and ass…

ObjectObject RecognitionObject SLAMSegmentation+3