paper-with-me

Papers

Topic mining based on fine-tuning Sentence-BERT and LDA

2025-04-07 · Jianheng Li, Lirong Chen

Research background: With the continuous development of society, consumers pay more attention to the key information of product fine-grained attributes when shopping. Research purposes: This study will fine tune the Sentence-BERT word embedding model and LDA model, mine the subject characteristics in online reviews of goods, and show consumers the details of various aspects of goods. Research methods: First, the Sentence-BERT model was fine tuned in the field of e-commerce online reviews, and the online review text was converted into a word vector set with richer semantic information; Secondly, the vectorized word set is input into the LDA model for topic feature extraction; Finally, focus on the key functions of the product through keyword analysis under the theme. Results: This study compared this model with other word embedding models and LDA models, and compared it with common topic extraction methods. The theme consistency of this model is 0.5 higher than that of other models, which improves the accuracy of theme extraction

📄 PDF Abstract BibTeX arXiv:2504.07984

Code (0)

등록된 구현이 없습니다.

Tasks

Sentence

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically
LDA Linear discriminant analysis (LDA), normal discriminant analysis (NDA), or discriminant function analysis is a generalization of Fisher's linear discriminant, a method used in…
Focus 설명 없음

Similar Papers 제목 키워드 기반

Zero-Shot Multi-Label Topic Inference with Sentence Encoders

2023-04-14 · Souvika Sarkar, Dongji Feng, Shubhra Kanti Karmaker Santu

Sentence encoders have indeed been shown to achieve superior performances for many downstream text-mining tasks and, thus, claimed to be fairly general. Inspired by this, we performed a detailed study on how to leverage …

Sentence

Topic Modeling with Fine-tuning LLMs and Bag of Sentences

2024-08-06 · Johannes Schneider

Large language models (LLM)'s are increasingly used for topic modeling outperforming classical topic models such as LDA. Commonly, pre-trained LLM encoders such as BERT are used out-of-the-box despite the fact that fine-…

SentenceTopic Models

Fine-tuning the SwissBERT Encoder Model for Embedding Sentences and Documents

2024-05-13 · Juri Grosjean, Jannis Vamvas

Encoder models trained for the embedding of sentences or short documents have proven useful for tasks such as semantic search and topic modeling. In this paper, we present a version of the SwissBERT encoder model that we…

ArticlesContrastive LearningRetrievaltext-classification+1

LimTopic: LLM-based Topic Modeling and Text Summarization for Analyzing Scientific Articles limitations

2025-03-08 · Ibrahim Al Azhar, Venkata Devesh Reddy, Hamed Alhoori, Akhil Pandey Akella

The limitations sections of scientific articles play a crucial role in highlighting the boundaries and shortcomings of research, thereby guiding future studies and improving research methods. Analyzing these limitations …

ArticlesPrompt EngineeringText Summarization

L3Cube-IndicSBERT: A simple approach for learning cross-lingual sentence representations using multilingual BERT

2023-04-22 · Samruddhi Deode, Janhavi Gadre, Aditi Kajale, Ananya Joshi 외

The multilingual Sentence-BERT (SBERT) models map different languages to common representation space and are useful for cross-language similarity and mining tasks. We propose a simple yet effective approach to convert va…

SentenceSentence SimilaritySTS