paper-with-me

홈 › Papers

Building Real-World Meeting Summarization Systems using Large Language Models: A Practical Perspective

2023-10-30 · Md Tahmid Rahman Laskar, Xue-Yong Fu, Cheng Chen, Shashi Bhushan TN

This paper studies how to effectively build meeting summarization systems for real-world usage using large language models (LLMs). For this purpose, we conduct an extensive evaluation and comparison of various closed-source and open-source LLMs, namely, GPT-4, GPT- 3.5, PaLM-2, and LLaMA-2. Our findings reveal that most closed-source LLMs are generally better in terms of performance. However, much smaller open-source models like LLaMA- 2 (7B and 13B) could still achieve performance comparable to the large closed-source models even in zero-shot scenarios. Considering the privacy concerns of closed-source models for only being accessible via API, alongside the high cost associated with using fine-tuned versions of the closed-source models, the opensource models that can achieve competitive performance are more advantageous for industrial use. Balancing performance with associated costs and privacy concerns, the LLaMA-2-7B model looks more promising for industrial usage. In sum, this paper offers practical insights on using LLMs for real-world business meeting summarization, shedding light on the trade-offs between performance and cost.

📄 PDF Abstract BibTeX arXiv:2310.19233

Code (0)

등록된 구현이 없습니다.

Tasks

Meeting Summarization

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…

Similar Papers 제목 키워드 기반

Abstractive Meeting Summarization: A Survey

2022-08-08 · Virgile Rennard, Guokan Shang, Julie Hunter, Michalis Vazirgiannis

A system that could reliably identify and sum up the most important points of a conversation would be valuable in a wide variety of real-world contexts, from business meetings to medical consultations to customer service…

Abstractive Dialogue SummarizationAbstractive Text SummarizationDecoderMeeting Summarization+2

Private Meeting Summarization Without Performance Loss

2023-05-25 · Seolhwa Lee, Anders Søgaard

Meeting summarization has an enormous business potential, but in addition to being a hard problem, roll-out is challenged by privacy concerns. We explore the problem of meeting summarization under differential privacy co…

Meeting Summarization

Tiny Titans: Can Smaller Large Language Models Punch Above Their Weight in the Real World for Meeting Summarization?

2024-02-01 · Xue-Yong Fu, Md Tahmid Rahman Laskar, Elena Khasanova, Cheng Chen 외

Large Language Models (LLMs) have demonstrated impressive capabilities to solve a wide range of tasks without being explicitly fine-tuned on task-specific datasets. However, deploying LLMs in the real world is not trivia…

Meeting Summarization

MeetingBank: A Benchmark Dataset for Meeting Summarization

2023-05-27 · Yebowen Hu, Tim Ganter, Hanieh Deilamsalehy, Franck Dernoncourt 외

As the number of recorded meetings increases, it becomes increasingly important to utilize summarization technology to create useful summaries of these recordings. However, there is a crucial lack of annotated meeting co…

Meeting Summarization

VCSUM: A Versatile Chinese Meeting Summarization Dataset

2023-05-09 · Han Wu, Mingjie Zhan, Haochen Tan, Zhaohui Hou 외

Compared to news and chat summarization, the development of meeting summarization is hugely decelerated by the limited data. To this end, we introduce a versatile Chinese meeting summarization dataset, dubbed VCSum, cons…

Meeting SummarizationRetrievalSegmentation