paper-with-me

Papers

Attention Modulation for Zero-Shot Cross-Domain Dialogue State Tracking

2022-10-01 · COLING (CODI, CRAC) 2022 10 · Mathilde Veron, Olivier Galibert, Guillaume Bernard, Sophie Rosset

Dialog state tracking (DST) is a core step for task-oriented dialogue systems aiming to track the user’s current goal during a dialogue. Recently a special focus has been put on applying existing DST models to new domains, in other words performing zero-shot cross-domain transfer. While recent state-of-the-art models leverage large pre-trained language models, no work has been made on understanding and improving the results of first developed zero-shot models like SUMBT. In this paper, we thus propose to improve SUMBT zero-shot results on MultiWOZ by using attention modulation during inference. This method improves SUMBT zero-shot results significantly on two domains and does not worsen the initial performance with the great advantage of needing no additional training.

📄 PDF Abstract BibTeX

Code (1)

mathilde-veron/attention-modulation-zero-dst 공식 구현 pytorch

Tasks

dialog state trackingDialogue State TrackingTask-Oriented Dialogue Systems

Methods 이 논문이 사용한 방법론

DST Dynamic sparse training methods train neural networks in a sparse manner, starting with an initial sparse mask, and periodically updating the mask based on some criteria.

Similar Papers 제목 키워드 기반

Efficient Zero-shot Visual Search via Target and Context-aware Transformer

2022-11-24 · Zhiwei Ding, Xuezhe Ren, Erwan David, Melissa Vo 외

Visual search is a ubiquitous challenge in natural vision, including daily tasks such as finding a friend in a crowd or searching for a car in a parking lot. Human rely heavily on relevant target features to perform goal…

If At First You Don't Succeed: Test Time Re-ranking for Zero-shot, Cross-domain Retrieval

2023-03-30 · Finlay G. C. Hudson, William A. P. Smith

In this paper we propose a novel method for zero-shot, cross-domain image retrieval in which we make two key contributions. The first is a test-time re-ranking procedure that enables query-gallery pairs, without meaningf…

Image RetrievalKnowledge DistillationRe-RankingRetrieval+1

Discrepancy-Aware Attention Network for Enhanced Audio-Visual Zero-Shot Learning

2024-12-16 · RunLin Yu, Yipu Gong, Wenrui Li, Aiwen Sun 외

Audio-visual Zero-Shot Learning (ZSL) has attracted significant attention for its ability to identify unseen classes and perform well in video classification tasks. However, modal imbalance in (G)ZSL leads to over-relian…

Video ClassificationZero-Shot Learning

CSI-Based Cross-Domain Activity Recognition via Zero-Shot Prototypical Networks

2023-12-12 · Guillermo Diaz, Iker Sobron, Inaki Eizmendi, Iratxe landa 외

The cross-domain capability of wireless sensing is currently one of the major challenges on human activity recognition (HAR) based on the channel state information (CSI) of wireless signals. The difficulty of labeling sa…

Activity RecognitionCross-Domain Activity RecognitionHuman Activity RecognitionZero-Shot Learning

Beyond Static Anchors: Bounded Prototype Conditioning for Language-Free Medical Anomaly Detection

2026-08-01 · Yibo Wan, Jinyu Cai, Seekiong-Ng arxiv

Medical anomaly detection identifies abnormal images and localizes lesions under scarce supervision while generalizing across organs and modalities. Existing CLIP-based methods reduce annotation requirements through visi…

Anomaly Detection