paper-with-me

Papers

Conformer and Blind Noisy Students for Improved Image Quality Assessment

2022-04-27 · Marcos V. Conde, Maxime Burchi, Radu Timofte

Generative models for image restoration, enhancement, and generation have significantly improved the quality of the generated images. Surprisingly, these models produce more pleasant images to the human eye than other methods, yet, they may get a lower perceptual quality score using traditional perceptual quality metrics such as PSNR or SSIM. Therefore, it is necessary to develop a quantitative metric to reflect the performance of new algorithms, which should be well-aligned with the person's mean opinion score (MOS). Learning-based approaches for perceptual image quality assessment (IQA) usually require both the distorted and reference image for measuring the perceptual quality accurately. However, commonly only the distorted or generated image is available. In this work, we explore the performance of transformer-based full-reference IQA models. We also propose a method for IQA based on semi-supervised knowledge distillation from full-reference teacher models into blind student models using noisy pseudo-labeled data. Our approaches achieved competitive results on the NTIRE 2022 Perceptual Image Quality Assessment Challenge: our full-reference model was ranked 4th, and our blind noisy student was ranked 3rd among 70 participants, each in their respective track.

📄 PDF Abstract BibTeX arXiv:2204.12819

Code (1)

burchim/iqa-conformer-bns 공식 구현 pytorch

Tasks

Image Quality AssessmentImage RestorationKnowledge DistillationNo-Reference Image Quality Assessment

Methods 이 논문이 사용한 방법론

Transformer A Transformer is a model architecture that eschews recurrence and instead relies entirely on an [attention…
Knowledge Distillation A very simple way to improve the performance of almost any machine learning algorithm is to train many different models on the same data and then to average their predictions.…
Noisy Student 설명 없음

Similar Papers 제목 키워드 기반

Conformer-Kernel with Query Term Independence at TREC 2020 Deep Learning Track

2020-11-14 · Bhaskar Mitra, Sebastian Hofstatter, Hamed Zamani, Nick Craswell

We benchmark Conformer-Kernel models under the strict blind evaluation setting of the TREC 2020 Deep Learning track. In particular, we study the impact of incorporating: (i) Explicit term matching to complement matching …

Retrieval

FBI-Denoiser: Fast Blind Image Denoiser for Poisson-Gaussian Noise

2021-05-23 · CVPR 2021 1 · Jaeseok Byun, Sungmin Cha, Taesup Moon

We consider the challenging blind denoising problem for Poisson-Gaussian noise, in which no additional information about clean images or noise level parameters is available. Particularly, when only "single" noisy images …

Denoising

DF-Conformer: Integrated architecture of Conv-TasNet and Conformer using linear complexity self-attention for speech enhancement

2021-06-30 · Yuma Koizumi, Shigeki Karita, Scott Wisdom, Hakan Erdogan 외

Single-channel speech enhancement (SE) is an important task in speech processing. A widely used framework combines an analysis/synthesis filterbank with a mask prediction network, such as the Conv-TasNet architecture. In…

Computational EfficiencyDenoisingPredictionSpeech Enhancement

An investigation of modularity for noise robustness in conformer-based ASR

2024-09-09 · Louise Coppieters de Gibson, Philip N. Garner, Pierre-Edouard Honnet

Whilst state of the art automatic speech recognition (ASR) can perform well, it still degrades when exposed to acoustic environments that differ from those used when training the model. Unfamiliar environments for a give…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

Comparative Analysis of Non-Blind Deblurring Methods for Noisy Blurred Images

2022-05-06 · Poorna Banerjee Dasgupta

Image blurring refers to the degradation of an image wherein the image's overall sharpness decreases. Image blurring is caused by several factors. Additionally, during the image acquisition process, noise may get added t…

Blind Image DeblurringDeblurringDenoisingImage Deblurring