paper-with-me

Papers

Convolutional autoencoder-based multimodal one-class classification

2023-09-25 · Firas Laakom, Fahad Sohrab, Jenni Raitoharju, Alexandros Iosifidis, Moncef Gabbouj

One-class classification refers to approaches of learning using data from a single class only. In this paper, we propose a deep learning one-class classification method suitable for multimodal data, which relies on two convolutional autoencoders jointly trained to reconstruct the positive input data while obtaining the data representations in the latent space as compact as possible. During inference, the distance of the latent representation of an input to the origin can be used as an anomaly score. Experimental results using a multimodal macroinvertebrate image classification dataset show that the proposed multimodal method yields better results as compared to the unimodal approach. Furthermore, study the effect of different input image sizes, and we investigate how recently proposed feature diversity regularizers affect the performance of our approach. We show that such regularizers improve performance.

📄 PDF Abstract BibTeX arXiv:2309.14090

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationDiversityimage-classificationImage ClassificationOne-Class Classification

Similar Papers 제목 키워드 기반

Unsupervised Multimodal Language Representations using Convolutional Autoencoders

2021-10-06 · Panagiotis Koromilas, Theodoros Giannakopoulos

Multimodal Language Analysis is a demanding area of research, since it is associated with two requirements: combining different modalities and capturing temporal information. During the last years, several works have bee…

Emotion RecognitionMultimodal Sentiment AnalysisSentiment Analysis

MU-MAE: Multimodal Masked Autoencoders-Based One-Shot Learning

2024-08-08 · Rex Liu, Xin Liu

With the exponential growth of multimedia data, leveraging multimodal sensors presents a promising approach for improving accuracy in human activity recognition. Nevertheless, accurately identifying these activities usin…

Activity RecognitionHuman Activity RecognitionOne-Shot Learning

DeepPainter: Painter Classification Using Deep Convolutional Autoencoders

2017-11-23 · Eli David, Nathan S. Netanyahu

In this paper we describe the problem of painter classification, and propose a novel approach based on deep convolutional autoencoder neural networks. While previous approaches relied on image processing and manual featu…

ClassificationGeneral Classification

Comparison of Autoencoders for tokenization of ASL datasets

2025-01-12 · Vouk Praun-Petrovic, Aadhvika Koundinya, Lavanya Prahallad

Generative AI, powered by large language models (LLMs), has revolutionized applications across text, audio, images, and video. This study focuses on developing and evaluating encoder-decoder architectures for the America…

DecoderDenoisingImage ReconstructionSign Language Recognition

Multimodal deep learning approach for joint EEG-EMG data compression and classification

2017-03-27 · Ahmed Ben Said, Amr Mohamed, Tarek Elfouly, Khaled Harras 외

In this paper, we present a joint compression and classification approach of EEG and EMG signals using a deep learning approach. Specifically, we build our system based on the deep autoencoder architecture which is desig…

Data CompressionDecoderEEGElectroencephalogram (EEG)+2