paper-with-me

홈 › Papers

Vision Transformer Equipped with Neural Resizer on Facial Expression Recognition Task

2022-04-05 · Hyeonbin Hwang, Soyeon Kim, Wei-Jin Park, Jiho Seo, Kyungtae Ko, Hyeon Yeo

When it comes to wild conditions, Facial Expression Recognition is often challenged with low-quality data and imbalanced, ambiguous labels. This field has much benefited from CNN based approaches; however, CNN models have structural limitation to see the facial regions in distant. As a remedy, Transformer has been introduced to vision fields with global receptive field, but requires adjusting input spatial size to the pretrained models to enjoy their strong inductive bias at hands. We herein raise a question whether using the deterministic interpolation method is enough to feed low-resolution data to Transformer. In this work, we propose a novel training framework, Neural Resizer, to support Transformer by compensating information and downscaling in a data-driven manner trained with loss function balancing the noisiness and imbalance. Experiments show our Neural Resizer with F-PDLS loss function improves the performance with Transformer variants in general and nearly achieves the state-of-the-art performance.

📄 PDF Abstract BibTeX arXiv:2204.02181

Code (0)

등록된 구현이 없습니다.

Tasks

Facial Expression RecognitionFacial Expression Recognition (FER)Inductive Bias

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Position-Wise Feed-Forward Layer 설명 없음

Similar Papers 제목 키워드 기반

MULLER: Multilayer Laplacian Resizer for Vision

2023-04-06 · ICCV 2023 1 · Zhengzhong Tu, Peyman Milanfar, Hossein Talebi

Image resizing operation is a fundamental preprocessing module in modern computer vision. Throughout the deep learning revolution, researchers have overlooked the potential of alternative resizing methods beyond the comm…

image-classificationImage ClassificationImage Quality Assessmentobject-detection+1

More comprehensive facial inversion for more effective expression recognition

2022-11-24 · Jiawei Mao, Guangyi Zhao, Yuanqi Chang, Xuesong Yin 외

Facial expression recognition (FER) plays a significant role in the ubiquitous application of computer vision. We revisit this problem with a new perspective on whether it can acquire useful representations that improve …

Facial Expression RecognitionFacial Expression Recognition (FER)Image Generation

Learning to Resize Images for Computer Vision Tasks

2021-03-17 · ICCV 2021 10 · Hossein Talebi, Peyman Milanfar

For all the ways convolutional neural nets have revolutionized computer vision in recent years, one important aspect has received surprisingly little attention: the effect of image size on the accuracy of tasks being tra…

Image Quality Assessment

Learning Vision Transformer with Squeeze and Excitation for Facial Expression Recognition

2021-07-07 · Mouath Aouayeb, Wassim Hamidouche, Catherine Soladie, Kidiyo Kpalma 외

As various databases of facial expressions have been made accessible over the last few decades, the Facial Expression Recognition (FER) task has gotten a lot of interest. The multiple sources of the available databases r…

Facial Expression Recognition (FER)

Emotion Separation and Recognition from a Facial Expression by Generating the Poker Face with Vision Transformers

2022-07-22 · Jia Li, Jiantao Nie, Dan Guo, Richang Hong 외

Representation learning and feature disentanglement have garnered significant research interest in the field of facial expression recognition (FER). The inherent ambiguity of emotion labels poses challenges for conventio…

DisentanglementFace GenerationFacial Expression RecognitionFacial Expression Recognition (FER)+1