paper-with-me

Papers

How to turn your camera into a perfect pinhole model

2023-09-20 · Ivan De Boi, Stuti Pathak, Marina Oliveira, Rudi Penne

Camera calibration is a first and fundamental step in various computer vision applications. Despite being an active field of research, Zhang's method remains widely used for camera calibration due to its implementation in popular toolboxes. However, this method initially assumes a pinhole model with oversimplified distortion models. In this work, we propose a novel approach that involves a pre-processing step to remove distortions from images by means of Gaussian processes. Our method does not need to assume any distortion model and can be applied to severely warped images, even in the case of multiple distortion sources, e.g., a fisheye image of a curved mirror reflection. The Gaussian processes capture all distortions and camera imperfections, resulting in virtual images as though taken by an ideal pinhole camera with square pixels. Furthermore, this ideal GP-camera only needs one image of a square grid calibration pattern. This model allows for a serious upgrade of many algorithms and applications that are designed in a pure projective geometry setting but with a performance that is very sensitive to nonlinear lens distortions. We demonstrate the effectiveness of our method by simplifying Zhang's calibration method, reducing the number of parameters and getting rid of the distortion parameters and iterative optimization. We validate by means of synthetic data and real world images. The contributions of this work include the construction of a virtual ideal pinhole camera using Gaussian processes, a simplified calibration method and lens distortion removal.

📄 PDF Abstract BibTeX arXiv:2309.11326

Code (0)

등록된 구현이 없습니다.

Tasks

Camera CalibrationGaussian Processes

Similar Papers 제목 키워드 기반

Do-It-Yourself Single Camera 3D Pointer Input Device

2018-09-12 · Bernard Llanos, Yee-Hong Yang

We present a new algorithm for single camera 3D reconstruction, or 3D input for human-computer interfaces, based on precise tracking of an elongated object, such as a pen, having a pattern of colored bands. To configure …

3D Reconstruction

Creating Realistic Ground Truth Data for the Evaluation of Calibration Methods for Plenoptic and Conventional Cameras

2022-03-09 · Tim Michels, Arne Petersen, Reinhard Koch

Camera calibration methods usually consist of capturing images of known calibration patterns and using the detected correspondences to optimize the parameters of the assumed camera model. A meaningful evaluation of these…

Camera Calibration

Deep Camera Obscura: An Image Restoration Pipeline for Lensless Pinhole Photography

2021-08-12 · Joshua D. Rego, Huaijin Chen, Shuai Li, Jinwei Gu 외

The lensless pinhole camera is perhaps the earliest and simplest form of an imaging system using only a pinhole-sized aperture in place of a lens. They can capture an infinite depth-of-field and offer greater freedom fro…

Image Restoration

Benchmarking Multi-View BEV Object Detection with Mixed Pinhole and Fisheye Cameras

2026-03-29 · Xiangzhong Liu, Hao Shen arxiv

Modern autonomous driving systems increasingly rely on mixed camera configurations with pinhole and fisheye cameras for full view perception. However, Bird's-Eye View (BEV) 3D object detection models are predominantly de…

3D Object DetectionAutonomous Driving

FBINeRF: Feature-Based Integrated Recurrent Network for Pinhole and Fisheye Neural Radiance Fields

2024-08-03 · Yifan Wu, Tianyi Cheng, Peixu Xin, Janusz Konrad

Previous studies aiming to optimize and bundle-adjust camera poses using Neural Radiance Fields (NeRFs), such as BARF and DBARF, have demonstrated impressive capabilities in 3D scene reconstruction. However, these approa…

3D Scene ReconstructionNeRF