paper-with-me

홈 › Papers

Video from Stills: Lensless Imaging with Rolling Shutter

2019-05-30 · Nick Antipa, Patrick Oare, Emrah Bostan, Ren Ng, Laura Waller

Because image sensor chips have a finite bandwidth with which to read out pixels, recording video typically requires a trade-off between frame rate and pixel count. Compressed sensing techniques can circumvent this trade-off by assuming that the image is compressible. Here, we propose using multiplexing optics to spatially compress the scene, enabling information about the whole scene to be sampled from a row of sensor pixels, which can be read off quickly via a rolling shutter CMOS sensor. Conveniently, such multiplexing can be achieved with a simple lensless, diffuser-based imaging system. Using sparse recovery methods, we are able to recover 140 video frames at over 4,500 frames per second, all from a single captured image with a rolling shutter sensor. Our proof-of-concept system uses easily-fabricated diffusers paired with an off-the-shelf sensor. The resulting prototype enables compressive encoding of high frame rate video into a single rolling shutter exposure, and exceeds the sampling-limited performance of an equivalent global shutter system for sufficiently sparse objects.

📄 PDF Abstract BibTeX arXiv:1905.13221

Code (1)

Waller-Lab/UDN pytorch

Tasks

compressed sensing

Similar Papers 제목 키워드 기반

Untrained networks for compressive lensless photography

2021-03-13 · Kristina Monakhova, Vi Tran, Grace Kuo, Laura Waller

Compressive lensless imagers enable novel applications in an extremely compact device, requiring only a phase or amplitude mask placed close to the sensor. They have been demonstrated for 2D and 3D microscopy, single-sho…

Compressive Sensing

R-SLAM: Optimizing Eye Tracking From Rolling Shutter Video of the Retina

2021-01-01 · ICCV 2021 10 · Jay Shenoy, James Fong, Jeffrey Tan, Austin Roorda 외

We present a method for optimization-based recovery of eye motion from rolling shutter video of the retina. Our approach formulates eye tracking as an optimization problem that jointly estimates the retina's motion a…

Rethinking Video Frame Interpolation from Shutter Mode Induced Degradation

2023-01-01 · ICCV 2023 1 · Xiang Ji, Zhixiang Wang, Zhihang Zhong, Yinqiang Zheng

Image restoration from various motion-related degradations, like blurry effects recorded by a global shutter (GS) and jello effects caused by a rolling shutter (RS), has been extensively studied. It has been recently…

DisentanglementImage RestorationVideo Frame Interpolation

Inertial-aided Rolling Shutter Relative Pose Estimation

2017-12-01 · Chang-Ryeol Lee, Kuk-Jin Yoon

Relative pose estimation is a fundamental problem in computer vision and it has been studied for conventional global shutter cameras for decades. However, recently, a rolling shutter camera has been widely used due to it…

Pose Estimation

Rolling Shutter Inversion: Bring Rolling Shutter Images to High Framerate Global Shutter Video

2022-10-06 · Bin Fan, Yuchao Dai, Hongdong Li

A single rolling-shutter (RS) image may be viewed as a row-wise combination of a sequence of global-shutter (GS) images captured by a (virtual) moving GS camera within the exposure duration. Although RS cameras are widel…

Optical Flow EstimationSuper-Resolution