CognitiveNet: Enriching Foundation Models with Emotions and Awareness
Foundation models are gaining considerable interest for their capacity of solving many downstream tasks without fine-tuning parameters on specific datasets. The same solutions can connect visual and linguistic representations through image-text contrastive learning. These abilities allow an artificial agent to act similarly to a human, but significant cognitive processes still need to be introduced in the learning process. The present study proposes an advancement to more human-like artificial intelligence by introducing CognitiveNet, a learnable architecture integrating foundation models. Starting from the latest studies in the field of Artificial Consciousness, a hierarchy of cognitive layers has been modeled and pre-trained for estimating the emotional content of images. By employing CLIP as the backbone model, significant concordant emotional activity was produced. Furthermore, the proposed model overcomes the accuracy of CLIP in classifying CIFAR-10 and -100 datasets through supervised optimization, suggesting CognitiveNet as a promising solution for solving classification tasks through online meta-learning.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningImage ClassificationIncremental LearningMeta-LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Deep Emotions Across Languages: A Novel Approach for Sentiment Propagation in Multilingual WordNets
Sentiment analysis involves using WordNets enriched with emotional metadata, which are valuable resources. However, manual annotation is time-consuming and expensive, resulting in only a few WordNet Lexical Units being a…
Sentiment AnalysisHuman-like Affective Cognition in Foundation Models
Understanding emotions is fundamental to human interaction and experience. Humans easily infer emotions from situations or facial expressions, situations from emotions, and do a variety of other affective cognition. How …
Semantically Enriching Investor Micro-blogs for Opinion-Aware Emotion Analysis: A Practical Approach
While sentiment analysis is the staple of financial NLP, capturing the nuances of 'why' behind that sentiment remains a challenge. There have been attempts to address this by analysing investor emotions alongside sentime…
Sentiment AnalysisRevisiting Emotions Representation for Recognition in the Wild
Facial emotion recognition has been typically cast as a single-label classification problem of one out of six prototypical emotions. However, that is an oversimplification that is unsuitable for representing the multifac…
Facial Emotion RecognitionDo Smart Glasses Dream of Sentimental Visions? Deep Emotionship Analysis for Eyewear Devices
Emotion recognition in smart eyewear devices is highly valuable but challenging. One key limitation of previous works is that the expression-related information like facial or eye images is considered as the only emotion…
Emotion Recognition