ChatGraph: Interpretable Text Classification by Converting ChatGPT Knowledge to Graphs
ChatGPT, as a recently launched large language model (LLM), has shown superior performance in various natural language processing (NLP) tasks. However, two major limitations hinder its potential applications: (1) the inflexibility of finetuning on downstream tasks and (2) the lack of interpretability in the decision-making process. To tackle these limitations, we propose a novel framework that leverages the power of ChatGPT for specific tasks, such as text classification, while improving its interpretability. The proposed framework conducts a knowledge graph extraction task to extract refined and structural knowledge from the raw data using ChatGPT. The rich knowledge is then converted into a graph, which is further used to train an interpretable linear classifier to make predictions. To evaluate the effectiveness of our proposed method, we conduct experiments on four datasets. The result shows that our method can significantly improve the performance compared to directly utilizing ChatGPT for text classification tasks. And our method provides a more transparent decision-making process compared with previous text classification methods.
Code (1)
Tasks
ClassificationDecision MakingLanguage ModelingLanguage ModellingLarge Language Modeltext-classificationText ClassificationSimilar Papers 제목 키워드 기반
ChatGraph: Chat with Your Graphs
Graph analysis is fundamental in real-world applications. Traditional approaches rely on SPARQL-like languages or clicking-and-dragging interfaces to interact with graph data. However, these methods either require users …
Language ModelingLanguage ModellingLarge Language ModelRetrievalHow would Stance Detection Techniques Evolve after the Launch of ChatGPT?
Stance detection refers to the task of extracting the standpoint (Favor, Against or Neither) towards a target in given texts. Such research gains increasing attention with the proliferation of social media contents. The …
Language ModellingStance Detectiontext-classificationText ClassificationTUR2SQL: A Cross-Domain Turkish Dataset For Text-to-SQL
The field of converting natural language into corresponding SQL queries using deep learning techniques has attracted significant attention in recent years. While existing Text-to-SQL datasets primarily focus on English a…
Text to SQLText-To-SQLTesting the Reliability of ChatGPT for Text Annotation and Classification: A Cautionary Remark
Recent studies have demonstrated promising potential of ChatGPT for various text annotation and classification tasks. However, ChatGPT is non-deterministic which means that, as with human coders, identical input can lead…
Classificationtext annotationCNMBERT: A Model for Converting Hanyu Pinyin Abbreviations to Chinese Characters
The task of converting Hanyu Pinyin abbreviations to Chinese characters is a significant branch within the domain of Chinese Spelling Correction (CSC). It plays an important role in many downstream applications such as n…
fill-maskFill MaskMixture-of-Expertsnamed-entity-recognition+3