paper-with-me

Papers

Automatic text-based speech overlap classification: A novel approach using Large Language Models

2023-06-25 · A Thesis Submitted to EEMCS Faculty Delft University of Technology, In Partial Fulfilment of the Requirements For the Bachelor of Computer Science and Engineering 2023 6 · J.H. Domhof

Meetings are the keystone of a good company. They allow for quick decision making, multiple-perspective problem solving and effective communication. However, most employees and managers have a negative view on the efficiency and quality of their meetings. High quality meetings where every participant feels equally heard and respected is crucial for having positive meeting sentiment within a company. One of the most influential aspects of meetings are speech overlaps. Overlaps range from short utterances such as backchannels, to follow up questions and clarifications, to complete interruptions. In non-competitive cases, the overlapped speaker feels that the other participants are listening and actively engaging with them during the meeting. In competitive cases, the overlapped speaker can feel interrupted and unimportant. Therefore, competitive overlaps often have a negative impact on the course of the discussion and the overlappee's meeting sentiment. In problematic cases, these overlaps should be reduced to a minimum. In order to do this, overlaps must be classified as either competitive or non-competitive. This paper proposes a novel approach to overlap classification, namely that of text-based classification through Large Language Models. Four different prompt designs are used and tested on the two best performing and publicly available models, GPT-3.5-turbo and GPT-4. The results show that the in-context learning approach using the GPT-4 model results in the most accurate classifications. When comparing the results to previous work, it is observed that the text-based GPT-4 model matches carefully engineered neural networks that even adopt a multi-modular approach.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

In-Context LearningSpeech Interruption Detection

Similar Papers 제목 키워드 기반

Unsupervised recognition and clustering of speech overlaps in spoken conversations

2014-09-11 · Workshop on Speech, Language and Audio in Multimedia (SLAM 2014) 2014 9 · Shammur Absar Chowdhury, Giuseppe Riccardi, Firoj Alam

We are interested in understanding speech overlaps and their function in human conversations. Previous studies on speech overlaps have relied on supervised methods, small corpora and controlled conversations. The charact…

ClusteringSpeech Interruption Detection

Audio-visual Multi-channel Recognition of Overlapped Speech

2020-05-18 · Jianwei Yu, Bo Wu, Rongzhi Gu, Shi-Xiong Zhang 외

Automatic speech recognition (ASR) of overlapped speech remains a highly challenging task to date. To this end, multi-channel microphone array data are widely used in state-of-the-art ASR systems. Motivated by the invari…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)LipreadingSentence+3

Automatic classification of speech overlaps: Feature representation and algorithms

2018-12-02 · Computer Speech & Language 55 (2019) 145-167 2018 12 · Shammur Absar Chowdhury, Evgeny A. Stepanov, Morena Danieli, Giuseppe Riccardi

Overlapping speech is a natural and frequently occurring phenomenon in humanhuman conversations with an underlying purpose. Speech overlap events may be categorized as competitive and non-competitive. While the former …

Speech Interruption DetectionWord Embeddings

Serialized Speech Information Guidance with Overlapped Encoding Separation for Multi-Speaker Automatic Speech Recognition

2024-09-01 · Hao Shi, Yuan Gao, Zhaoheng Ni, Tatsuya Kawahara

Serialized output training (SOT) attracts increasing attention due to its convenience and flexibility for multi-speaker automatic speech recognition (ASR). However, it is not easy to train with attention loss only. In th…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)speech-recognitionSpeech Recognition

A Mixture of Expert Based Deep Neural Network for Improved ASR

2021-12-02 · Vishwanath Pratap Singh, Shakti P. Rath, Abhishek Pandey

This paper presents a novel deep learning architecture for acoustic model in the context of Automatic Speech Recognition (ASR), termed as MixNet. Besides the conventional layers, such as fully connected layers in DNN-HMM…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Mixture-of-Expertsspeech-recognition+1