paper-with-me

홈 › Papers

UW-ProCCaps: UnderWater Progressive Colourisation with Capsules

2023-07-03 · Rita Pucci, Niki Martinel

Underwater images are fundamental for studying and understanding the status of marine life. We focus on reducing the memory space required for image storage while the memory space consumption in the collecting phase limits the time lasting of this phase leading to the need for more image collection campaigns. We present a novel machine-learning model that reconstructs the colours of underwater images from their luminescence channel, thus saving 2/3 of the available storage space. Our model specialises in underwater colour reconstruction and consists of an encoder-decoder architecture. The encoder is composed of a convolutional encoder and a parallel specialised classifier trained with webly-supervised data. The encoder and the decoder use layers of capsules to capture the features of the entities in the image. The colour reconstruction process recalls the progressive and the generative adversarial training procedures. The progressive training gives the ground for a generative adversarial routine focused on the refining of colours giving the image bright and saturated colours which bring the image back to life. We validate the model both qualitatively and quantitatively on four benchmark datasets. This is the first attempt at colour reconstruction in greyscale underwater images. Extensive results on four benchmark datasets demonstrate that our solution outperforms state-of-the-art (SOTA) solutions. We also demonstrate that the generated colourisation enhances the quality of images compared to enhancement models at the SOTA.

📄 PDF Abstract BibTeX arXiv:2307.01091

Code (0)

등록된 구현이 없습니다.

Tasks

Decoder

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

TUCaN: Progressively Teaching Colourisation to Capsules

2021-06-29 · Rita Pucci, Niki Martinel

Automatic image colourisation is the computer vision research path that studies how to colourise greyscale images (for restoration). Deep learning techniques improved image colourisation yielding astonishing results. The…

Is It a Plausible Colour? UCapsNet for Image Colourisation

2020-12-04 · Rita Pucci, Christian Micheloni, Gian Luca Foresti, Niki Martinel

Human beings can imagine the colours of a grayscale image with no particular effort thanks to their ability of semantic feature extraction. Can an autonomous system achieve that? Can it hallucinate plausible and vibrant …

Self-Supervised Learning

Collaboration among Image and Object Level Features for Image Colourisation

2021-01-19 · Rita Pucci, Christian Micheloni, Niki Martinel

Image colourisation is an ill-posed problem, with multiple correct solutions which depend on the context and object instances present in the input datum. Previous approaches attacked the problem either by requiring inten…

Object

UW-CVGAN: UnderWater Image Enhancement with Capsules Vectors Quantization

2023-02-02 · Rita Pucci, Christian Micheloni, Niki Martinel

The degradation in the underwater images is due to wavelength-dependent light attenuation, scattering, and to the diversity of the water types in which they are captured. Deep neural networks take a step in this field, p…

DecoderDiversityImage EnhancementQuantization

Human vs Objective Evaluation of Colourisation Performance

2022-04-11 · Seán Mullery, Paul F. Whelan

Automatic colourisation of grey-scale images is the process of creating a full-colour image from the grey-scale prior. It is an ill-posed problem, as there are many plausible colourisations for a given grey-scale prior. …