paper-with-me

홈 › Papers

Differentiable Uncalibrated Imaging

2022-11-18 · Sidharth Gupta, Konik Kothari, Valentin Debarnot, Ivan Dokmanić

We propose a differentiable imaging framework to address uncertainty in measurement coordinates such as sensor locations and projection angles. We formulate the problem as measurement interpolation at unknown nodes supervised through the forward operator. To solve it we apply implicit neural networks, also known as neural fields, which are naturally differentiable with respect to the input coordinates. We also develop differentiable spline interpolators which perform as well as neural networks, require less time to optimize and have well-understood properties. Differentiability is key as it allows us to jointly fit a measurement representation, optimize over the uncertain measurement coordinates, and perform image reconstruction which in turn ensures consistent calibration. We apply our approach to 2D and 3D computed tomography, and show that it produces improved reconstructions compared to baselines that do not account for the lack of calibration. The flexibility of the proposed framework makes it easy to extend to almost arbitrary imaging problems.

📄 PDF Abstract BibTeX arXiv:2211.10525

Code (1)

swing-research/differentiable_uncalibrated_imaging 공식 구현 pytorch

Tasks

Image Reconstruction

Similar Papers 제목 키워드 기반

DANI-Net: Uncalibrated Photometric Stereo by Differentiable Shadow Handling, Anisotropic Reflectance Modeling, and Neural Inverse Rendering

2023-03-27 · CVPR 2023 1 · Zongrui Li, Qian Zheng, Boxin Shi, Gang Pan 외

Uncalibrated photometric stereo (UPS) is challenging due to the inherent ambiguity brought by the unknown light. Although the ambiguity is alleviated on non-Lambertian objects, the problem is still difficult to solve for…

Inverse Rendering

Neural Architecture Search for Efficient Uncalibrated Deep Photometric Stereo

2021-10-11 · Francesco Sarno, Suryansh Kumar, Berk Kaya, Zhiwu Huang 외

We present an automated machine learning approach for uncalibrated photometric stereo (PS). Our work aims at discovering lightweight and computationally efficient PS neural networks with excellent surface normal accuracy…

Neural Architecture Search

Physically Parameterized Differentiable MUSIC for DoA Estimation with Uncalibrated Arrays

2024-11-06 · Baptiste Chatelier, José Miguel Mateos-Ramos, Vincent Corlay, Christian Häger 외

Direction of arrival (DoA) estimation is a common sensing problem in radar, sonar, audio, and wireless communication systems. It has gained renewed importance with the advent of the integrated sensing and communication p…

Integrated sensing and communication

A Modality-agnostic Multi-task Foundation Model for Human Brain Imaging

2025-08-30 · Peirong Liu, Oula Puonti, Xiaoling Hu, Karthik Gopinath 외 arxiv

Recent learning-based approaches have made astonishing advances in calibrated medical imaging like computerized tomography (CT), yet they struggle to generalize in uncalibrated modalities -- notably magnetic resonance (M…

A Lighting-Invariant Point Processor for Shading

2020-06-01 · CVPR 2020 6 · Kathryn Heal, Jialiang Wang, Steven J. Gortler, Todd Zickler

Under the conventional diffuse shading model with unknown directional lighting, the set of quadratic surface shapes that are consistent with the spatial derivatives of intensity at a single image point is a two-dimension…