paper-with-me

Papers

They See Me Rollin': Inherent Vulnerability of the Rolling Shutter in CMOS Image Sensors

2021-01-25 · Sebastian Köhler, Giulio Lovisotto, Simon Birnbach, Richard Baker, Ivan Martinovic

In this paper, we describe how the electronic rolling shutter in CMOS image sensors can be exploited using a bright, modulated light source (e.g., an inexpensive, off-the-shelf laser), to inject fine-grained image disruptions. We demonstrate the attack on seven different CMOS cameras, ranging from cheap IoT to semi-professional surveillance cameras, to highlight the wide applicability of the rolling shutter attack. We model the fundamental factors affecting a rolling shutter attack in an uncontrolled setting. We then perform an exhaustive evaluation of the attack's effect on the task of object detection, investigating the effect of attack parameters. We validate our model against empirical data collected on two separate cameras, showing that by simply using information from the camera's datasheet the adversary can accurately predict the injected distortion size and optimize their attack accordingly. We find that an adversary can hide up to 75% of objects perceived by state-of-the-art detectors by selecting appropriate attack parameters. We also investigate the stealthiness of the attack in comparison to a na\"{i}ve camera blinding attack, showing that common image distortion metrics can not detect the attack presence. Therefore, we present a new, accurate and lightweight enhancement to the backbone network of an object detector to recognize rolling shutter attacks. Overall, our results indicate that rolling shutter attacks can substantially reduce the performance and reliability of vision-based intelligent systems.

📄 PDF Abstract BibTeX arXiv:2101.10011

Code (1)

ssloxford/they-see-me-rollin 공식 구현

Tasks

object-detectionObject Detection

Similar Papers 제목 키워드 기반

RSL-BA: Rolling Shutter Line Bundle Adjustment

2024-08-10 · Yongcong Zhang, Bangyan Liao, Yifei Xue, Chen Lu 외

The line is a prevalent element in man-made environments, inherently encoding spatial structural information, thus making it a more robust choice for feature representation in practical applications. Despite its apparent…

Rolling Shutter Correction in Manhattan World

2017-10-01 · ICCV 2017 10 · Pulak Purkait, Christopher Zach, Ales Leonardis

A vast majority of consumer cameras operate the rolling shutter mechanism, which often produces distorted images due to inter-row delay while capturing an image. Recent methods for monocular rolling shutter compensation …

Rolling Shutter Correction

Inertial-aided Rolling Shutter Relative Pose Estimation

2017-12-01 · Chang-Ryeol Lee, Kuk-Jin Yoon

Relative pose estimation is a fundamental problem in computer vision and it has been studied for conventional global shutter cameras for decades. However, recently, a rolling shutter camera has been widely used due to it…

Pose Estimation

Minimal Rolling Shutter Absolute Pose with Unknown Focal Length and Radial Distortion

2020-04-29 · ECCV 2020 8 · Zuzana Kukelova, Cenek Albl, Akihiro Sugimoto, Konrad Schindler 외

The internal geometry of most modern consumer cameras is not adequately described by the perspective projection. Almost all cameras exhibit some radial lens distortion and are equipped with an electronic rolling shutter …

From two rolling shutters to one global shutter

2020-06-02 · CVPR 2020 6 · Cenek Albl, Zuzana Kukelova, Viktor Larsson, Tomas Pajdla 외

Most consumer cameras are equipped with electronic rolling shutter, leading to image distortions when the camera moves during image capture. We explore a surprisingly simple camera configuration that makes it possible to…

Vocal Bursts Valence Prediction