Causal Intervention for Subject-Deconfounded Facial Action Unit Recognition
Subject-invariant facial action unit (AU) recognition remains challenging for the reason that the data distribution varies among subjects. In this paper, we propose a causal inference framework for subject-invariant facial action unit recognition. To illustrate the causal effect existing in AU recognition task, we formulate the causalities among facial images, subjects, latent AU semantic relations, and estimated AU occurrence probabilities via a structural causal model. By constructing such a causal diagram, we clarify the causal effect among variables and propose a plug-in causal intervention module, CIS, to deconfound the confounder \emph{Subject} in the causal diagram. Extensive experiments conducted on two commonly used AU benchmark datasets, BP4D and DISFA, show the effectiveness of our CIS, and the model with CIS inserted, CISNet, has achieved state-of-the-art performance.
Code (0)
등록된 구현이 없습니다.
Tasks
Causal InferenceFacial Action Unit DetectionSimilar Papers 제목 키워드 기반
Deconfounded Reasoning for Multimodal Fake News Detection via Causal Intervention
The rapid growth of social media has led to the widespread dissemination of fake news across multiple content forms, including text, images, audio, and video. Traditional unimodal detection methods fall short in addressi…
DisentanglementFake News DetectionThe Deconfounded Recommender: A Causal Inference Approach to Recommendation
The goal of recommendation is to show users items that they will like. Though usually framed as a prediction, the spirit of recommendation is to answer an interventional question---for each user and movie, what would the…
Causal InferenceRecommendation SystemsInterventional Multi-Instance Learning with Deconfounded Instance-Level Prediction
When applying multi-instance learning (MIL) to make predictions for bags of instances, the prediction accuracy of an instance often depends on not only the instance itself but also its context in the corresponding bag. F…
Causal InferencePredictionDeconfounded Video Moment Retrieval with Causal Intervention
We tackle the task of video moment retrieval (VMR), which aims to localize a specific moment in a video according to a textual query. Existing methods primarily model the matching relationship between query and moment by…
Moment RetrievalRetrievalWeakly-Supervised Video Object Grounding via Causal Intervention
We target at the task of weakly-supervised video object grounding (WSVOG), where only video-sentence annotations are available during model learning. It aims to localize objects described in the sentence to visual region…
Contrastive LearningObjectSentence