Incremental Unit Networks for Multimodal, Fine-grained Information State Representation
We offer a fine-grained information state annotation scheme that follows directly from the Incremental Unit abstract model of dialogue processing when used within a multimodal, co-located, interactive setting. We explain the Incremental Unit model and give an example application using the Localized Narratives dataset, then offer avenues for future research.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
ERNIE-mmLayout: Multi-grained MultiModal Transformer for Document Understanding
Recent efforts of multimodal Transformers have improved Visually Rich Document Understanding (VrDU) tasks via incorporating visual and textual information. However, existing approaches mainly focus on fine-grained elemen…
Common Sense Reasoningdocument understandingQuestion AnsweringMMEdge: Accelerating On-device Multimodal Inference via Pipelined Sensing and Encoding
Real-time multimodal inference on resource-constrained edge devices is essential for applications such as autonomous driving, human-computer interaction, and mobile health. However, prior work often overlooks the tight c…
Autonomous DrivingDReX: An Explainable Deep Learning-based Multimodal Recommendation Framework
Multimodal recommender systems leverage diverse data sources, such as user interactions, content features, and contextual information, to address challenges like cold-start and data sparsity. However, existing methods of…
Multimodal RecommendationNew Benchmark Dataset and Fine-Grained Cross-Modal Fusion Framework for Vietnamese Multimodal Aspect-Category Sentiment Analysis
The emergence of multimodal data on social media platforms presents new opportunities to better understand user sentiments toward a given aspect. However, existing multimodal datasets for Aspect-Category Sentiment Analys…
Aspect Category Sentiment AnalysisMultimodal Sentiment AnalysisSentiment AnalysisVietnamese Datasets+3A streamlined Approach to Multimodal Few-Shot Class Incremental Learning for Fine-Grained Datasets
Few-shot Class-Incremental Learning (FSCIL) poses the challenge of retaining prior knowledge while learning from limited new data streams, all without overfitting. The rise of Vision-Language models (VLMs) has unlocked n…
class-incremental learningClass Incremental LearningFew-Shot Class-Incremental LearningIncremental Learning