ZeroDL: Zero-shot Distribution Learning for Text Clustering via Large Language Models
The recent advancements in large language models (LLMs) have brought significant progress in solving NLP tasks. Notably, in-context learning (ICL) is the key enabling mechanism for LLMs to understand specific tasks and grasping nuances. In this paper, we propose a simple yet effective method to contextualize a task toward a specific LLM, by (1) observing how a given LLM describes (all or a part of) target datasets, i.e., open-ended zero-shot inference, and (2) aggregating the open-ended inference results by the LLM, and (3) finally incorporate the aggregated meta-information for the actual task. We show the effectiveness of this approach in text clustering tasks, and also highlight the importance of the contextualization through examples of the above procedure.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringIn-Context LearningText ClusteringSimilar Papers 제목 키워드 기반
Distribution Aligned Feature Clustering for Zero-Shot Sketch-Based Image Retrieval
Zero-Shot Sketch-Based Image Retrieval (ZS-SBIR) is a challenging cross-modal retrieval task. In prior arts, the retrieval is conducted by sorting the distance between the query sketch and each image in the gallery. Howe…
ClusteringCross-Modal RetrievalImage RetrievalRetrieval+1Beyond Prompting: Making Pre-trained Language Models Better Zero-shot Learners by Clustering Representations
Recent work has demonstrated that pre-trained language models (PLMs) are zero-shot learners. However, most existing zero-shot methods involve heavy human engineering or complicated self-training pipelines, hindering thei…
ClusteringSentenceSentence EmbeddingsSentiment Analysis+5In-Context Clustering with Large Language Models
We propose In-Context Clustering (ICC), a flexible LLM-based procedure for clustering data from diverse distributions. Unlike traditional clustering algorithms constrained by predefined similarity measures, ICC flexibly …
Image ClusteringTAG: A Simple Yet Effective Temporal-Aware Approach for Zero-Shot Video Temporal Grounding
Video Temporal Grounding (VTG) aims to extract relevant video segments based on a given natural language query. Recently, zero-shot VTG methods have gained attention by leveraging pretrained vision-language models (VLMs)…
CXR-CML: Improved zero-shot classification of long-tailed multi-label diseases in Chest X-Rays
Chest radiography (CXR) plays a crucial role in the diagnosis of various diseases. However, the inherent class imbalance in the distribution of clinical findings presents a significant challenge for current self-supervis…