paper-with-me

Papers

Cascading Convolutional Temporal Colour Constancy

2021-06-15 · Matteo Rizzo, Cristina Conati, Daesik Jang, Hui Hu

Computational Colour Constancy (CCC) consists of estimating the colour of one or more illuminants in a scene and using them to remove unwanted chromatic distortions. Much research has focused on illuminant estimation for CCC on single images, with few attempts of leveraging the temporal information intrinsic in sequences of correlated images (e.g., the frames in a video), a task known as Temporal Colour Constancy (TCC). The state-of-the-art for TCC is TCCNet, a deep-learning architecture that uses a ConvLSTM for aggregating the encodings produced by CNN submodules for each image in a sequence. We extend this architecture with different models obtained by (i) substituting the TCCNet submodules with C4, the state-of-the-art method for CCC targeting images; (ii) adding a cascading strategy to perform an iterative improvement of the estimate of the illuminant. We tested our models on the recently released TCC benchmark and achieved results that surpass the state-of-the-art. Analyzing the impact of the number of frames involved in illuminant estimation on performance, we show that it is possible to reduce inference time by training the models on few selected frames from the sequences while retaining comparable accuracy.

📄 PDF Abstract BibTeX arXiv:2106.07955

Code (1)

matteo-rizzo/cctcc 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Tanh Activation 설명 없음
ConvLSTM ConvLSTM is a type of recurrent neural network for spatio-temporal prediction that has convolutional structures in both the input-to-state and state-to-state transitions. The…

Similar Papers 제목 키워드 기반

Revisiting and Optimising a CNN Colour Constancy Method for Multi-Illuminant Estimation

2022-11-03 · Ghalia Hemrit, Joseph Meehan

The aim of colour constancy is to discount the effect of the scene illumination from the image colours and restore the colours of the objects as captured under a 'white' illuminant. For the majority of colour constancy m…

Cascading Convolutional Color Constancy

2019-12-24 · Huanglin Yu, Ke Chen, Kaiqi Wang, Yanlin Qian 외

Regressing the illumination of a scene from the representations of object appearances is popularly adopted in computational color constancy. However, it's still challenging due to intrinsic appearance and label ambiguiti…

Color Constancy

Evaluating the Faithfulness of Saliency-based Explanations for Deep Learning Models for Temporal Colour Constancy

2022-11-15 · Matteo Rizzo, Cristina Conati, Daesik Jang, Hui Hu

The opacity of deep learning models constrains their debugging and improvement. Augmenting deep models with saliency-based strategies, such as attention, has been claimed to help get a better understanding of the decisio…

Decision Making

Colour alignment for relative colour constancy via non-standard references

2021-12-30 · Yunfeng Zhao, Stuart Ferguson, Huiyu Zhou, Chris Elliott 외

Relative colour constancy is an essential requirement for many scientific imaging applications. However, most digital cameras differ in their image formations and native sensor output is usually inaccessible, e.g., in sm…

Recurrent Color Constancy

2017-10-01 · ICCV 2017 10 · Yanlin Qian, Ke Chen, Jarno Nikkanen, Joni-Kristian Kamarainen 외

We introduce a novel formulation of temporal color constancy which considers multiple frames preceding the frame for which illumination is estimated. We propose an end-to-end trainable recurrent color constancy network -…

Color Constancy