paper-with-me

홈 › Papers

Unsupervised paradigm for information extraction from transcripts using BERT

2021-10-03 · Aravind Chandramouli, Siddharth Shukla, Neeti Nair, Shiven Purohit, Shubham Pandey, Murali Mohana Krishna Dandu

Audio call transcripts are one of the valuable sources of information for multiple downstream use cases such as understanding the voice of the customer and analyzing agent performance. However, these transcripts are noisy in nature and in an industry setting, getting tagged ground truth data is a challenge. In this paper, we present a solution implemented in the industry using BERT Language Models as part of our pipeline to extract key topics and multiple open intents discussed in the call. Another problem statement we looked at was the automatic tagging of transcripts into predefined categories, which traditionally is solved using supervised approach. To overcome the lack of tagged data, all our proposed approaches use unsupervised methods to solve the outlined problems. We evaluate the results by quantitatively comparing the automatically extracted topics, intents and tagged categories with human tagged ground truth and by qualitatively measuring the valuable concepts and intents that are not present in the ground truth. We achieved near human accuracy in extraction of these topics and intents using our novel approach

📄 PDF Abstract BibTeX arXiv:2110.00949

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
WordPiece 설명 없음
Adam 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Residual Connection 설명 없음
Weight Decay 설명 없음

Similar Papers 제목 키워드 기반

Unsupervised Topic Segmentation of Meetings with BERT Embeddings

2021-06-24 · Alessandro Solbiati, Kevin Heffernan, Georgios Damaskinos, Shivani Poddar 외

Topic segmentation of meetings is the task of dividing multi-person meeting transcripts into topic blocks. Supervised approaches to the problem have proven intractable due to the difficulties in collecting and accurately…

Segmentation

Fin-ExBERT: User Intent based Text Extraction in Financial Context using Graph-Augmented BERT and trainable Plugin

2025-09-27 · Soumick Sarker, Abhijit Kumar Rai arxiv

Financial dialogue transcripts pose a unique challenge for sentence-level information extraction due to their informal structure, domain-specific vocabulary, and variable intent density. We introduce Fin-ExBERT, a lightw…

Information Extraction

Swin-BERT: A Feature Fusion System designed for Speech-based Alzheimer's Dementia Detection

2024-10-09 · Yilin Pan, Yanpei Shi, Yijia Zhang, Mingyu Lu

Speech is usually used for constructing an automatic Alzheimer's dementia (AD) detection system, as the acoustic and linguistic abilities show a decline in people living with AD at the early stages. However, speech inclu…

Rhythm

Improving Noise Robustness for Spoken Content Retrieval using Semi-supervised ASR and N-best Transcripts for BERT-based Ranking Models

2023-01-15 · Yasufumi Moriya, Gareth. J. F. Jones

BERT-based re-ranking and dense retrieval (DR) systems have been shown to improve search effectiveness for spoken content retrieval (SCR). However, both methods can still show a reduction in effectiveness when using ASR …

Re-RankingRetrieval

Automating the Information Extraction from Semi-Structured Interview Transcripts

2024-03-07 · Angelina Parfenova

This paper explores the development and application of an automated system designed to extract information from semi-structured interview transcripts. Given the labor-intensive nature of traditional qualitative analysis …

Topic Models