paper-with-me

홈 › Papers

Resampling and super-resolution of hexagonally sampled images using deep learning

2021-11-03 · Dylan Flaute, Russell C. Hardie, Hamed Elwarfalli

Super-resolution (SR) aims to increase the resolution of imagery. Applications include security, medical imaging, and object recognition. We propose a deep learning-based SR system that takes a hexagonally sampled low-resolution image as an input and generates a rectangularly sampled SR image as an output. For training and testing, we use a realistic observation model that includes optical degradation from diffraction and sensor degradation from detector integration. Our SR approach first uses non-uniform interpolation to partially upsample the observed hexagonal imagery and convert it to a rectangular grid. We then leverage a state-of-the-art convolutional neural network (CNN) architecture designed for SR known as Residual Channel Attention Network (RCAN). In particular, we use RCAN to further upsample and restore the imagery to produce the final SR image estimate. We demonstrate that this system is superior to applying RCAN directly to rectangularly sampled LR imagery with equivalent sample density. The theoretical advantages of hexagonal sampling are well known. However, to the best of our knowledge, the practical benefit of hexagonal sampling in light of modern processing techniques such as RCAN SR is heretofore untested. Our SR system demonstrates a notable advantage of hexagonally sampled imagery when employing a modified RCAN for hexagonal SR.

📄 PDF Abstract BibTeX arXiv:2111.02520

Code (0)

등록된 구현이 없습니다.

Tasks

Deep LearningObject RecognitionSuper-Resolution

Similar Papers 제목 키워드 기반

HexagDLy - Processing hexagonally sampled data with CNNs in PyTorch

2019-03-05 · Constantin Steppa, Tim Lukas Holch

HexagDLy is a Python-library extending the PyTorch deep learning framework with convolution and pooling operations on hexagonal grids. It aims to ease the access to convolutional neural networks for applications that rel…

Fitting Segmentation Networks on Varying Image Resolutions using Splatting

2022-06-13 · Mikael Brudfors, Yael Balbastre, John Ashburner, Geraint Rees 외

Data used in image segmentation are not always defined on the same grid. This is particularly true for medical images, where the resolution, field-of-view and orientation can differ across channels and subjects. Images a…

Image SegmentationSemantic Segmentation

Sub-band coding of hexagonal images

2021-10-06 · Md Mamunur Rashid, Usman R. Alim

According to the circle-packing theorem, the packing efficiency of a hexagonal lattice is higher than an equivalent square tessellation. Consequently, in several contexts, hexagonally sampled images compared to their Car…

Scale factor point spread function matching: Beyond aliasing in image resampling

2021-01-16 · M. Jorge Cardoso, Marc Modat, Tom Vercauteren, Sebastien Ourselin

Imaging devices exploit the Nyquist-Shannon sampling theorem to avoid both aliasing and redundant oversampling by design. Conversely, in medical image resampling, images are considered as continuous functions, are warped…

Super-Resolution Reconstruction of Electrical Impedance Tomography Images

2016-12-30 · Ricardo A. Borsoi, Julio C. C. Aya, Guilherme H. Costa, José C. M. Bermudez

Electrical Impedance Tomography (EIT) systems are becoming popular because they present several advantages over competing systems. However, EIT leads to images with very low resolution. Moreover, the nonuniform sampling …

Super-Resolution