paper-with-me

홈 › Papers

Neural-Network-Enhanced Metalens Camera for High-Definition, Dynamic Imaging in the Long-Wave Infrared Spectrum

2024-11-26 · Jing-Yang Wei, Hao Huang, Xin Zhang, De-Mao Ye, Yi Li, Le Wang, Yao-Guang Ma, Yang-Hui Li

To provide a lightweight and cost-effective solution for the long-wave infrared imaging using a singlet, we develop a camera by integrating a High-Frequency-Enhancing Cycle-GAN neural network into a metalens imaging system. The High-Frequency-Enhancing Cycle-GAN improves the quality of the original metalens images by addressing inherent frequency loss introduced by the metalens. In addition to the bidirectional cyclic generative adversarial network, it incorporates a high-frequency adversarial learning module. This module utilizes wavelet transform to extract high-frequency components, and then establishes a high-frequency feedback loop. It enables the generator to enhance the camera outputs by integrating adversarial feedback from the high-frequency discriminator. This ensures that the generator adheres to the constraints imposed by the high-frequency adversarial loss, thereby effectively recovering the camera's frequency loss. This recovery guarantees high-fidelity image output from the camera, facilitating smooth video production. Our camera is capable of achieving dynamic imaging at 125 frames per second with an End Point Error value of 12.58. We also achieve 0.42 for Fr\'echet Inception Distance, 30.62 for Peak Signal to Noise Ratio, and 0.69 for Structural Similarity in the recorded videos.

📄 PDF Abstract BibTeX arXiv:2411.17139

Code (0)

등록된 구현이 없습니다.

Tasks

Generative Adversarial Network

Similar Papers 제목 키워드 기반

Enabling High-Quality In-the-Wild Imaging from Severely Aberrated Metalens Bursts

2025-10-11 · Debabrata Mandal, Zhihan Peng, Yujie Wang, Praneeth Chakravarthula arxiv

We tackle the challenge of robust, in-the-wild imaging using ultra-thin nanophotonic metalens cameras. Meta-lenses, composed of planar arrays of nanoscale scatterers, promise dramatic reductions in size and weight compar…

Image Restoration

MetaScope: Optics-Driven Neural Network for Ultra-Micro Metalens Endoscopy

2025-08-05 · Wuyang Li, Wentao Pan, Xiaoyuan Liu, Zhendong Luo 외 arxiv

Miniaturized endoscopy has advanced accurate visual perception within the human body. Prevailing research remains limited to conventional cameras employing convex lenses, where the physical constraints with millimetre-sc…

Learned split-spectrum metalens for obstruction-free broadband imaging in the visible

2026-01-27 · Seungwoo Yoon, Dohyun Kang, Eunsue Choi, Sohyun Lee 외 arxiv

Obstructions such as raindrops, fences, or dust degrade captured images, especially when mechanical cleaning is infeasible. Conventional solutions to obstructions rely on a bulky compound optics array or computational in…

Semantic SegmentationObject Detection

Aberration Correcting Vision Transformers for High-Fidelity Metalens Imaging

2024-12-05 · Byeonghyeon Lee, Youbin Kim, Yongjae Jo, Hyunsu Kim 외

Metalens is an emerging optical system with an irreplaceable merit in that it can be manufactured in ultra-thin and compact sizes, which shows great promise in various applications. Despite its advantage in miniaturizati…

3D ReconstructionImage Restoration

MetaRanker: Human-in-the-loop Active Ranking for Metalens Image Quality

2026-05-28 · Yujin Park, Haejun Chung, Ikbeom Jang arxiv

Image quality in modern imaging systems emerges from the coupled effects of the sensor, optics, and computational reconstruction. Ultra-thin metalenses offer a path toward substantial miniaturization of optical modules, …

Image Quality Assessment