paper-with-me

홈 › Papers

Can LLMs Understand the Implication of Emphasized Sentences in Dialogue?

2024-06-16 · Guan-Ting Lin, Hung-Yi Lee

Emphasis is a crucial component in human communication, which indicates the speaker's intention and implication beyond pure text in dialogue. While Large Language Models (LLMs) have revolutionized natural language processing, their ability to understand emphasis in dialogue remains unclear. This paper introduces Emphasized-Talk, a benchmark with emphasis-annotated dialogue samples capturing the implications of emphasis. We evaluate various LLMs, both open-source and commercial, to measure their performance in understanding emphasis. Additionally, we propose an automatic evaluation pipeline using GPT-4, which achieves a high correlation with human rating. Our findings reveal that although commercial LLMs generally perform better, there is still significant room for improvement in comprehending emphasized sentences.

📄 PDF Abstract BibTeX arXiv:2406.11065

Code (1)

DanielLin94144/Emphasized-Talk 공식 구현

Methods 이 논문이 사용한 방법론

Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
Adam 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.

Similar Papers 제목 키워드 기반

In Dialogue with Intelligence: Rethinking Large Language Models as Collective Knowledge

2025-05-28 · Eleni Vasilaki

Large Language Models (LLMs) are typically analysed through architectural, behavioural, or training-data lenses. This article offers a theoretical and experiential re-framing: LLMs as dynamic instantiations of Collective…

From Personas to Talks: Revisiting the Impact of Personas on LLM-Synthesized Emotional Support Conversations

2025-02-17 · Shenghan Wu, Yang Deng, Yimo Zhu, Wynne Hsu 외

The rapid advancement of Large Language Models (LLMs) has revolutionized the generation of emotional support conversations (ESC), offering scalable solutions with reduced costs and enhanced data privacy. This paper explo…

DOGE: Towards Versatile Visual Document Grounding and Referring

2024-11-26 · Yinan Zhou, Yuxin Chen, Haokun Lin, Shuyu Yang 외

In recent years, Multimodal Large Language Models (MLLMs) have increasingly emphasized grounding and referring capabilities to achieve detailed understanding and flexible user interaction. However, in the realm of visual…

document understanding

Incorporate Dependency Relation Knowledge into Transformer Block for Multi-turn Dialogue Generation

2021-12-17 · ACL ARR December 2022 12 · Anonymous

Because of the compositionality of natural language, syntactic structure is one of the key factors for semantic understanding. However, the Transformer block, which is widely used for obtaining the distributed representa…

Dialogue GenerationRelation

Cutting Through the Confusion and Hype: Understanding the True Potential of Generative AI

2024-10-22 · Ante Prodan, Jo-An Occhipinti, Rehez Ahlip, Goran Ujdur 외

This paper explores the nuanced landscape of generative AI (genAI), particularly focusing on neural network-based models like Large Language Models (LLMs). While genAI garners both optimistic enthusiasm and sceptical cri…