Papers Multi-modal Classification
“Multi-modal Classification” 태그가 달린 논문 37편 · 필터 해제
Multiscale Multimodal Transformer for Multimodal Action Recognition
While action recognition has been an active research area for several years, most existing approaches merely leverage the video modality as opposed to humans that efficiently process video and audio cues simultaneously. …
Action RecognitionAudio ClassificationMulti-modal ClassificationRepresentation LearningUAVM: Towards Unifying Audio and Visual Models
Conventional audio-visual models have independent audio and video branches. In this work, we unify the audio and visual branches by designing a Unified Audio-Visual Model (UAVM). The UAVM achieves a new state-of-the-art …
Audio Classificationaudio-visual learningMulti-modal ClassificationMulti-Modal Hypergraph Diffusion Network with Dual Prior for Alzheimer Classification
The automatic early diagnosis of prodromal stages of Alzheimer's disease is of great relevance for patient treatment to improve quality of life. We address this problem as a multi-modal classification task. Multi-modal d…
Multi-modal ClassificationOn Modality Bias Recognition and Reduction
Making each modality in multi-modal data contribute is of vital importance to learning a versatile multi-modal model. Existing methods, however, are often dominated by one or few of modalities during model training, resu…
Action RecognitionMulti-modal ClassificationQuestion AnsweringTemporal Action Localization+2Multimodal Dynamics: Dynamical Fusion for Trustworthy Multimodal Classification
Integration of heterogeneous and high-dimensional data (e.g., multiomics) is becoming increasingly important. Existing multimodal classification algorithms mainly focus on improving performance by exploiting the comp…
ClassificationInformativenessMedical DiagnosisMulti-modal ClassificationMulti Task Learning based Framework for Multimodal Classification
Large-scale multi-modal classification aim to distinguish between different multi-modal data, and it has drawn dramatically attentions since last decade. In this paper, we propose a multi-task learning-based framework fo…
ClassificationMulti-modal ClassificationMulti-Task LearningMulti-modal Sarcasm Detection and Humor Classification in Code-mixed Conversations
Sarcasm detection and humor classification are inherently subtle problems, primarily due to their dependence on the contextual and non-verbal information. Furthermore, existing studies in these two topics are usually con…
ClassificationMulti-modal ClassificationSarcasm DetectionSentenceCross-Modal Retrieval Augmentation for Multi-Modal Classification
Recent advances in using retrieval components over external knowledge sources have shown impressive results for a variety of downstream tasks in natural language processing. Here, we explore the use of unstructured exter…
ClassificationCross-Modal RetrievalGeneral ClassificationMulti-modal Classification+4Learning Multi-Modal Nonlinear Embeddings: Performance Bounds and an Algorithm
While many approaches exist in the literature to learn low-dimensional representations for data collections in multiple modalities, the generalizability of multi-modal nonlinear embeddings to previously unseen data is a …
cross-modal alignmentGeneral Classificationimage-classificationImage Classification+5Look, Read and Enrich. Learning from Scientific Figures and their Captions
Compared to natural images, understanding scientific figures is particularly hard for machines. However, there is a valuable source of information in scientific literature that until now has remained untapped: the corres…
Multi-modal ClassificationQuestion AnsweringReading ComprehensionAssessing Post Deletion in Sina Weibo: Multi-modal Classification of Hot Topics
Widespread Chinese social media applications such as Weibo are widely known for monitoring and deleting posts to conform to Chinese government requirements. In this paper, we focus on analyzing a dataset of censored and …
General ClassificationMulti-modal ClassificationWhat Makes Training Multi-Modal Classification Networks Hard?
Consider end-to-end training of a multi-modal vs. a single-modal network on a task with multiple input modalities: the multi-modal network receives more information, so it should match or outperform its single-modal coun…
Action ClassificationAction RecognitionAction Recognition In VideosClassification+4Image and Encoded Text Fusion for Multi-Modal Classification
Multi-modal approaches employ data from multiple input streams such as textual and visual domains. Deep neural networks have been successfully employed for these approaches. In this paper, we present a novel multi-modal …
ClassificationGeneral ClassificationMulti-modal ClassificationCuisineNet: Food Attributes Classification using Multi-scale Convolution Network
Diversity of food and its attributes represents the culinary habits of peoples from different countries. Thus, this paper addresses the problem of identifying food culture of people around the world and its flavor by cla…
ClassificationCultural Vocal Bursts Intensity PredictionDiversityGeneral Classification+1Efficient Large-Scale Multi-Modal Classification
While the incipient internet was largely text-based, the modern digital world is becoming increasingly multi-modal. Here, we examine multi-modal classification where one modality is discrete, e.g. text, and the other is …
ClassificationComputational EfficiencyGeneral ClassificationMulti-modal ClassificationDeep Multi-Modal Classification of Intraductal Papillary Mucinous Neoplasms (IPMN) with Canonical Correlation Analysis
Pancreatic cancer has the poorest prognosis among all cancer types. Intraductal Papillary Mucinous Neoplasms (IPMNs) are radiographically identifiable precursors to pancreatic cancer; hence, early detection and precise r…
General ClassificationMulti-modal ClassificationPrognosisMulti-modal Fusion for Diabetes Mellitus and Impaired Glucose Regulation Detection
Effective and accurate diagnosis of Diabetes Mellitus (DM), as well as its early stage Impaired Glucose Regulation (IGR), has attracted much attention recently. Traditional Chinese Medicine (TCM) [3], [5] etc. has proved…
Multi-modal Classification