paper-with-me

홈 › Papers

Learning Monocular Depth from Focus with Event Focal Stack

2024-05-11 · Chenxu Jiang, Mingyuan Lin, Chi Zhang, Zhenghai Wang, Lei Yu

Depth from Focus estimates depth by determining the moment of maximum focus from multiple shots at different focal distances, i.e. the Focal Stack. However, the limited sampling rate of conventional optical cameras makes it difficult to obtain sufficient focus cues during the focal sweep. Inspired by biological vision, the event camera records intensity changes over time in extremely low latency, which provides more temporal information for focus time acquisition. In this study, we propose the EDFF Network to estimate sparse depth from the Event Focal Stack. Specifically, we utilize the event voxel grid to encode intensity change information and project event time surface into the depth domain to preserve per-pixel focal distance information. A Focal-Distance-guided Cross-Modal Attention Module is presented to fuse the information mentioned above. Additionally, we propose a Multi-level Depth Fusion Block designed to integrate results from each level of a UNet-like architecture and produce the final output. Extensive experiments validate that our method outperforms existing state-of-the-art approaches.

📄 PDF Abstract BibTeX arXiv:2405.06944

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Deep Eyes: Binocular Depth-from-Focus on Focal Stack Pairs

2017-11-29 · Xinqing Guo, Zhang Chen, Siyuan Li, Yang Yang 외

Human visual system relies on both binocular stereo cues and monocular focusness cues to gain effective 3D perception. In computer vision, the two problems are traditionally solved in separate tracks. In this paper, we p…

Stereo MatchingStereo Matching Hand

Dense Depth from Event Focal Stack

2024-12-11 · Kenta Horikawa, Mariko Isogawa, Hideo Saito, Shohei Mori

We propose a method for dense depth estimation from an event stream generated when sweeping the focal plane of the driving lens attached to an event camera. In this method, a depth map is inferred from an ``event focal s…

Depth Estimation

FocDepthFormer: Transformer with latent LSTM for Depth Estimation from Focal Stack

2023-10-17 · Xueyang Kang, Fengze Han, Abdur R. Fayjie, Patrick Vandewalle 외

Most existing methods for depth estimation from a focal stack of images employ convolutional neural networks (CNNs) using 2D or 3D convolutions over a fixed set of images. However, their effectiveness is constrained by t…

DecoderDepth Estimation

Depth Estimation Based on 3D Gaussian Splatting Siamese Defocus

2024-09-18 · Jinchang Zhang, Ningning Xu, Hao Zhang, Guoyu Lu

Depth estimation is a fundamental task in 3D geometry. While stereo depth estimation can be achieved through triangulation methods, it is not as straightforward for monocular methods, which require the integration of glo…

3D geometryDepth EstimationMonocular Depth EstimationStereo Depth Estimation

All-in-Focus Imaging From Event Focal Stack

2023-01-01 · CVPR 2023 1 · Hanyue Lou, Minggui Teng, Yixin Yang, Boxin Shi

Traditional focal stack methods require multiple shots to capture images focused at different distances of the same scene, which cannot be applied to dynamic scenes well. Generating a high-quality all-in-focus image …

AllDeblurring