paper-with-me

홈 › Papers

Feature Representation Learning with Adaptive Displacement Generation and Transformer Fusion for Micro-Expression Recognition

2023-04-10 · CVPR 2023 1 · Zhijun Zhai, Jianhui Zhao, Chengjiang Long, Wenju Xu, Shuangjiang He, Huijuan Zhao

Micro-expressions are spontaneous, rapid and subtle facial movements that can neither be forged nor suppressed. They are very important nonverbal communication clues, but are transient and of low intensity thus difficult to recognize. Recently deep learning based methods have been developed for micro-expression (ME) recognition using feature extraction and fusion techniques, however, targeted feature learning and efficient feature fusion still lack further study according to the ME characteristics. To address these issues, we propose a novel framework Feature Representation Learning with adaptive Displacement Generation and Transformer fusion (FRL-DGT), in which a convolutional Displacement Generation Module (DGM) with self-supervised learning is used to extract dynamic features from onset/apex frames targeted to the subsequent ME recognition task, and a well-designed Transformer Fusion mechanism composed of three Transformer-based fusion modules (local, global fusions based on AU regions and full-face fusion) is applied to extract the multi-level informative features after DGM for the final ME prediction. The extensive experiments with solid leave-one-subject-out (LOSO) evaluation results have demonstrated the superiority of our proposed FRL-DGT to state-of-the-art methods.

📄 PDF Abstract BibTeX arXiv:2304.04420

Code (0)

등록된 구현이 없습니다.

Tasks

Micro Expression RecognitionMicro-Expression RecognitionRepresentation LearningSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Residual Connection 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

RepKPU: Point Cloud Upsampling with Kernel Point Representation and Deformation

2024-01-01 · CVPR 2024 1 · Yi Rong, Haoran Zhou, Kang Xia, Cheng Mei 외

In this work we present RepKPU an efficient network for point cloud upsampling. We propose to promote upsampling performance by exploiting better shape representation and point generation strategy. Inspired by KPConv…

point cloud upsampling

Adaptive O-CNN: A Patch-based Deep Representation of 3D Shapes

2018-09-21 · Peng-Shuai Wang, Chun-Yu Sun, Yang Liu, Xin Tong

We present an Adaptive Octree-based Convolutional Neural Network (Adaptive O-CNN) for efficient 3D shape encoding and decoding. Different from volumetric-based or octree-based CNN methods that represent a 3D shape with v…

Decoder

UTSRMorph: A Unified Transformer and Superresolution Network for Unsupervised Medical Image Registration

2024-10-27 · Runshi Zhang, Hao Mo, Junchen Wang, Bimeng Jie 외

Complicated image registration is a key issue in medical image analysis, and deep learning-based methods have achieved better results than traditional methods. The methods include ConvNet-based and Transformer-based meth…

DecoderImage RegistrationMedical Image AnalysisMedical Image Registration+2

Improving Image Captioning by Leveraging Intra- and Inter-layer Global Representation in Transformer Network

2020-12-13 · Jiayi Ji, Yunpeng Luo, Xiaoshuai Sun, Fuhai Chen 외

Transformer-based architectures have shown great success in image captioning, where object regions are encoded and then attended into the vectorial representations to guide the caption decoding. However, such vectorial r…

Caption GenerationDecoderImage Captioning

nGPT: Normalized Transformer with Representation Learning on the Hypersphere

2024-10-01 · Ilya Loshchilov, Cheng-Ping Hsieh, Simeng Sun, Boris Ginsburg

We propose a novel neural network architecture, the normalized Transformer (nGPT) with representation learning on the hypersphere. In nGPT, all vectors forming the embeddings, MLP, attention matrices and hidden states ar…

Representation Learning