paper-with-me

Papers

Small Changes Make Big Differences: Improving Multi-turn Response Selection in Dialogue Systems via Fine-Grained Contrastive Learning

2021-11-19 · Yuntao Li, Can Xu, Huang Hu, Lei Sha, Yan Zhang, Daxin Jiang

Retrieve-based dialogue response selection aims to find a proper response from a candidate set given a multi-turn context. Pre-trained language models (PLMs) based methods have yielded significant improvements on this task. The sequence representation plays a key role in the learning of matching degree between the dialogue context and the response. However, we observe that different context-response pairs sharing the same context always have a greater similarity in the sequence representations calculated by PLMs, which makes it hard to distinguish positive responses from negative ones. Motivated by this, we propose a novel \textbf{F}ine-\textbf{G}rained \textbf{C}ontrastive (FGC) learning method for the response selection task based on PLMs. This FGC learning strategy helps PLMs to generate more distinguishable matching representations of each dialogue at fine grains, and further make better predictions on choosing positive responses. Empirical studies on two benchmark datasets demonstrate that the proposed FGC learning method can generally and significantly improve the model performance of existing PLM-based matching models.

📄 PDF Abstract BibTeX arXiv:2111.10154

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningConversational Response Selection

Similar Papers 제목 키워드 기반

Small Changes Make Big Differences: Improving Multi-turn Response Selection in Dialogue Systems via Fine-Grained Contrastive Learning

2022-01-16 · ACL ARR January 2022 1 · Anonymous

Retrieve-based dialogue response selection aims to find a proper response from a candidate set given a multi-turn context. Pre-trained language models (PLMs) based methods have yielded significant improvements on this ta…

Contrastive Learning

The Evolution of Unobserved Skill Returns in the U.S.: A New Approach Using Panel Data

2025-01-17 · Lance Lochner, Youngmin Park, Youngki Shin

Economists disagree about the factors driving the substantial increase in residual wage inequality in the US over the past few decades. To identify changes in the returns to unobserved skills, we make a novel assumption …

DELTAVID: Enhancing Fine-Grained Spatiotemporal Perception with Cross-Video Differences

2026-06-26 · Yankai Yang, Yancheng Long, Bin Wen, Fan Yang 외 arxiv

Video multimodal large language models have made strong progress on open-ended video understanding, but they still lack precise local spatiotemporal perception. When two videos share almost the same global semantics and …

Brain-wide functional imaging to highlight differences between the diurnal and nocturnal neuronal activity in zebrafish larvae

2023-04-19 · Giuseppe de Vito, Lapo Turrini, Chiara Fornetto, Elena Trabalzini 외

Most living organisms show highly conserved physiological changes following a 24-hour cycle which goes by the name of circadian rhythm. Among experimental models, the effects of light-dark cycle have been recently invest…

Rhythm

Should I Stay or Should I Go Now? An Investigation into Gender Differences in the Impact of Switching Jobs on Earnings

2025-05-14 · Emily Winskill

This paper investigates the relationship between job mobility and earnings growth in the UK labour market, with a focus on gender differences in the returns to switching jobs. Using data from the Annual Survey of Hours a…