ADVISER: A Toolkit for Developing Multi-modal, Multi-domain and Socially-engaged Conversational Agents
We present ADVISER - an open-source, multi-domain dialog system toolkit that enables the development of multi-modal (incorporating speech, text and vision), socially-engaged (e.g. emotion recognition, engagement level prediction and backchanneling) conversational agents. The final Python-based implementation of our toolkit is flexible, easy to use, and easy to extend not only for technically experienced users, such as machine learning researchers, but also for less technically experienced users, such as linguists or cognitive scientists, thereby providing a flexible platform for collaborative research. Link to open-source code: https://github.com/DigitalPhonetics/adviser
Code (1)
Tasks
BIG-bench Machine LearningEmotion RecognitionSimilar Papers 제목 키워드 기반
VideoAdviser: Video Knowledge Distillation for Multimodal Transfer Learning
Multimodal transfer learning aims to transform pretrained representations of diverse modalities into a common domain space for effective multimodal fusion. However, conventional systems are typically built on the assumpt…
Knowledge DistillationregressionSentiment AnalysisTransfer LearningLearning from Failures: Retrieval-Centric CoT via Hard Negatives for Unified Multimodal Retrieval
Unified multimodal retrieval aims to identify candidates that satisfy complex user intent expressed through heterogeneous inputs. Although Large Vision-Language Model (LVLM)-based retrievers are efficient and scalable, d…
Reinforcement LearningMADDM: Multi-Advisor Dynamic Binary Decision-Making by Maximizing the Utility
Being able to infer ground truth from the responses of multiple imperfect advisors is a problem of crucial importance in many decision-making applications, such as lending, trading, investment, and crowd-sourcing. In pra…
Decision MakingADVISER: A Dialog System Framework for Education \& Research
In this paper, we present ADVISER - an open source dialog system framework for education and research purposes. This system supports multi-domain task-oriented conversations in two languages. It additionally provides a f…
Analysis of Advisor Portfolio using Multivariate Time Series and Cosine Similarity
In mutual fund, an investment adviser gives advice to clients about investing in securities such as stocks, bonds, mutual funds, or exchange traded funds. Some investment advisers manage portfolios of securities. In this…
Time SeriesTime Series Analysis