Convolutional autoencoder-based multimodal one-class classification
One-class classification refers to approaches of learning using data from a single class only. In this paper, we propose a deep learning one-class classification method suitable for multimodal data, which relies on two convolutional autoencoders jointly trained to reconstruct the positive input data while obtaining the data representations in the latent space as compact as possible. During inference, the distance of the latent representation of an input to the origin can be used as an anomaly score. Experimental results using a multimodal macroinvertebrate image classification dataset show that the proposed multimodal method yields better results as compared to the unimodal approach. Furthermore, study the effect of different input image sizes, and we investigate how recently proposed feature diversity regularizers affect the performance of our approach. We show that such regularizers improve performance.
Code (0)
등록된 구현이 없습니다.
Tasks
ClassificationDiversityimage-classificationImage ClassificationOne-Class ClassificationSimilar Papers 제목 키워드 기반
Unsupervised Multimodal Language Representations using Convolutional Autoencoders
Multimodal Language Analysis is a demanding area of research, since it is associated with two requirements: combining different modalities and capturing temporal information. During the last years, several works have bee…
Emotion RecognitionMultimodal Sentiment AnalysisSentiment AnalysisMU-MAE: Multimodal Masked Autoencoders-Based One-Shot Learning
With the exponential growth of multimedia data, leveraging multimodal sensors presents a promising approach for improving accuracy in human activity recognition. Nevertheless, accurately identifying these activities usin…
Activity RecognitionHuman Activity RecognitionOne-Shot LearningDeepPainter: Painter Classification Using Deep Convolutional Autoencoders
In this paper we describe the problem of painter classification, and propose a novel approach based on deep convolutional autoencoder neural networks. While previous approaches relied on image processing and manual featu…
ClassificationGeneral ClassificationComparison of Autoencoders for tokenization of ASL datasets
Generative AI, powered by large language models (LLMs), has revolutionized applications across text, audio, images, and video. This study focuses on developing and evaluating encoder-decoder architectures for the America…
DecoderDenoisingImage ReconstructionSign Language RecognitionMultimodal deep learning approach for joint EEG-EMG data compression and classification
In this paper, we present a joint compression and classification approach of EEG and EMG signals using a deep learning approach. Specifically, we build our system based on the deep autoencoder architecture which is desig…
Data CompressionDecoderEEGElectroencephalogram (EEG)+2