paper-with-me

Papers

Passive Screen-to-Camera Communication

2024-03-24 · Seyed Keyarash Ghiasi, Marco Kaldenbach, Marco Zuniga

A recent technology known as transparent screens is transforming windows into displays. These smart windows are present in buses, airports and offices. They can remain transparent, as a normal window, or display relevant information that overlays their panoramic views. In this paper, we propose transforming these windows not only into screens but also into wireless transmitters. To achieve this goal, we build upon the research area of screen-to-camera communication. In this area, videos are modified in a way that smartphone cameras can decode data out of them, while this data remains invisible to the viewers. A person sees a normal video, but the camera sees the video plus additional information. In this communication method, one of the biggest disadvantages is the traditional screens' power consumption, more than 80% of which is used to generate light. To solve this, we employ novel transparent screens relying on ambient light to display pictures, hence eliminating the power source. However, this comes at the cost of a lower image quality, since they use variable and out-of-control environment light, instead of generating a constant and strong light by LED panels. Our work, dubbed PassiveCam, overcomes the challenge of creating the first screen-to-camera communication link using passive displays. This paper presents two main contributions. First, we analyze and modify existing screens and encoding methods to embed information reliably in ambient light. Second, we develop an Android App that optimizes the decoding process, obtaining a real-time performance. Our evaluation, which considers a musical application, shows a Packet Success Rate (PSR) of close to 90%. In addition, our real-time application achieves response times of 530 ms and 1071 ms when the camera is static and when it is hand-held, respectively.

📄 PDF Abstract BibTeX arXiv:2403.16185

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Towards Zero-power 3D Imaging: VLC-assisted Passive ToF Sensing

2023-07-17 · Faisal Ahmed, Miguel Heredia Conde, Paula López Martínez

Passive Time-of-Flight (ToF) imaging can be enabled by optical wireless communication (OWC). The lighting infrastructure is the backbone of emerging light-based wireless communication. To this end, communication sources …

Non Line-of-Sight Optical Wireless Communication using Neuromorphic Cameras

2025-03-14 · Abbaas Alif Mohamed Nishar, Alireza Marefat, Ashwin Ashok

Neuromorphic or event cameras, inspired by biological vision systems, capture changes in illumination with high temporal resolution and efficiency, producing streams of events rather than traditional images. In this pape…

Revelio: A Real-World Screen-Camera Communication System with Visually Imperceptible Data Embedding

2025-01-04 · Abbaas Alif Mohamed Nishar, Shrinivas Kudekar, Bernard Kintzing, Ashwin Ashok

We present `Revelio', a real-world screen-camera communication system leveraging temporal flicker fusion in the OKLAB color space. Using spatially-adaptive flickering and encoding information in pixel region shapes, Reve…

Decoder

Motion-Aware Optical Camera Communication with Event Cameras

2024-12-01 · Hang Su, Ling Gao, Tao Liu, Laurent Kneip

As the ubiquity of smart mobile devices continues to rise, Optical Camera Communication systems have gained more attention as a solution for efficient and private data streaming. This system utilizes optical cameras to r…

DeepLight: Robust & Unobtrusive Real-time Screen-Camera Communication for Real-World Displays

2021-05-11 · Vu Tran, Gihan Jayatilaka, Ashwin Ashok, Archan Misra

The paper introduces a novel, holistic approach for robust Screen-Camera Communication (SCC), where video content on a screen is visually encoded in a human-imperceptible fashion and decoded by a camera capturing images …

Decoderobject-detectionObject Detection