Array Camera Image Fusion using Physics-Aware Transformers
We demonstrate a physics-aware transformer for feature-based data fusion from cameras with diverse resolution, color spaces, focal planes, focal lengths, and exposure. We also demonstrate a scalable solution for synthetic training data generation for the transformer using open-source computer graphics software. We demonstrate image synthesis on arrays with diverse spectral responses, instantaneous field of view and frame rate.
Code (1)
Tasks
Image GenerationSimilar Papers 제목 키워드 기반
Neighbor-Aware View Synthesis for Restoring Missing Views in Light-Field Camera Arrays
In light-field (LF) imaging systems, dense spatial sampling from a camera array enables powerful post-capture capabilities such as refocusing and depth estimation. However, real-world LF capture is often affected by hard…
Depth EstimationEnhanced Self-Supervised Multi-Image Super-Resolution for Camera Array Images
Conventional multi-image super-resolution (MISR) methods, such as burst and video SR, rely on sequential frames from a single camera. Consequently, they suffer from complex image degradation and severe occlusion, increas…
Self-Supervised LearningImage Super-ResolutionImage RestorationMicrolens array grid estimation, light field decoding, and calibration
We quantitatively investigate multiple algorithms for microlens array grid estimation for microlens array-based light field cameras. Explicitly taking into account natural and mechanical vignetting effects, we propose a …
Thin On-Sensor Nanophotonic Array Cameras
Today's commodity camera systems rely on compound optics to map light originating from the scene to positions on the sensor where it gets recorded as an image. To record images without optical aberrations, i.e., deviatio…
Anomaly Awareness
We present a new algorithm for anomaly detection called Anomaly Awareness. The algorithm learns about normal events while being made aware of the anomalies through a modification of the cost function. We show how this me…
Anomaly DetectionBIG-bench Machine Learning