Deep Homography for Efficient Stereo Image Compression
In this paper, we propose HESIC, an end-to-end trainable deep network for stereo image compression (SIC). To fully explore the mutual information across two stereo images, we use a deep regression model to estimate the homography matrix, i.e., H matrix. Then, the left image is spatially transformed by the H matrix, and only the residual information between the left and right images is encoded to save bit-rates. A two-branch auto-encoder architecture is adopted in HESIC, corresponding to the left and right images, respectively. For entropy coding, we propose two conditional stereo entropy models, i.e., Gaussian mixture model (GMM) based and context based entropy models, to fully explore the correlation between the two images to reduce the coding bit-rates. In decoding, a cross quality enhancement module is proposed to enhance the image quality based on inverse H matrix. Experimental results show that our HESIC outperforms state-of-the-art SIC methods on InStereo2K and KITTI datasets both quantitatively and qualitatively.
Code (1)
Tasks
Image CompressionSimilar Papers 제목 키워드 기반
Color Homography Color Correction
Homographies -- a mathematical formalism for relating image points across different camera viewpoints -- are at the foundations of geometric methods in computer vision and are used in geometric camera calibration, image …
Camera CalibrationImage RegistrationPixel-variant Local Homography for Fisheye Stereo Rectification Minimizing Resampling Distortion
Large field-of-view fisheye lens cameras have attracted more and more researchers' attention in the field of robotics. However, there does not exist a convenient off-the-shelf stereo rectification approach which can be a…
3D ReconstructionStereo MatchingStereo Matching HandDive Deeper into Rectifying Homography for Stereo Camera Online Self-Calibration
Accurate estimation of stereo camera extrinsic parameters is the key to guarantee the performance of stereo matching algorithms. In prior arts, the online self-calibration of stereo cameras has commonly been formulated a…
parameter estimationStereo MatchingVisual OdometryStereo Unstructured Magnification: Multiple Homography Image for View Synthesis
This paper studies the problem of view synthesis with certain amount of rotations from a pair of images, what we called stereo unstructured magnification. While the multi-plane image representation is well suited for vie…
Novel View SynthesisRobust Uncalibrated Stereo Rectification with Constrained Geometric Distortions (USR-CGD)
A novel algorithm for uncalibrated stereo image-pair rectification under the constraint of geometric distortion, called USR-CGD, is presented in this work. Although it is straightforward to define a rectifying transforma…