Rolling Shutter and Radial Distortion Are Features for High Frame Rate Multi-Camera Tracking
Traditionally, camera-based tracking approaches have treated rolling shutter and radial distortion as imaging artifacts that have to be overcome and corrected for in order to apply standard camera models and scene reconstruction methods. In this paper, we introduce a novel multi-camera tracking approach that for the first time jointly leverages the information introduced by rolling shutter and radial distortion as a feature to achieve superior performance with respect to high-frequency camera pose estimation. In particular, our system is capable of attaining high tracking rates that were previously unachievable. Our approach explicitly leverages rolling shutter capture and radial distortion to process individual rows, rather than entire image frames, for accurate camera motion estimation. We estimate a per-row 6 DoF pose of a rolling shutter camera by tracking multiple points on a radially distorted row whose rays span a curved surface in 3D space. Although tracking systems for rolling shutter cameras exist, we are the first to leverage radial distortion to measure a per-row pose -- enabling us to use less than half the number of cameras required by the previous state of the art. We validate our system on both synthetic and real imagery.
Code (0)
등록된 구현이 없습니다.
Tasks
Camera Pose EstimationMotion EstimationPose EstimationSimilar Papers 제목 키워드 기반
Minimal Rolling Shutter Absolute Pose with Unknown Focal Length and Radial Distortion
The internal geometry of most modern consumer cameras is not adequately described by the perspective projection. Almost all cameras exhibit some radial lens distortion and are equipped with an electronic rolling shutter …
From two rolling shutters to one global shutter
Most consumer cameras are equipped with electronic rolling shutter, leading to image distortions when the camera moves during image capture. We explore a surprisingly simple camera configuration that makes it possible to…
Vocal Bursts Valence PredictionSUNet: Symmetric Undistortion Network for Rolling Shutter Correction
The vast majority of modern consumer-grade cameras employ a rolling shutter mechanism, leading to image distortions if the camera moves during image acquisition. In this paper, we present a novel deep network to solve th…
DecoderRolling Shutter CorrectionRolling Shutter Camera Calibration
Rolling Shutter (RS) cameras are used across a wide range of consumer electronic devices--from smart-phones to high-end cameras. It is well known, that if a RS camera is used with a moving camera or scene, significant im…
Camera CalibrationIMU-Assisted Learning of Single-View Rolling Shutter Correction
Rolling shutter distortion is highly undesirable for photography and computer vision algorithms (e.g., visual SLAM) because pixels can be potentially captured at different times and poses. In this paper, we propose a dee…
Pose PredictionRolling Shutter Correction