Dynamic data summarization for hierarchical spatial clustering
Hierarchical Density-Based Spatial Clustering of Applications with Noise (HDBSCAN) finds meaningful patterns in spatial data by considering density and spatial proximity. As the clustering algorithm is inherently designed for static applications, so have recent studies focused on accelerating the algorithm for static applications using approximate or parallel methods. However, much less attention has been given to dynamic environments, where even a single point insertion or deletion can require recomputing the clustering hierarchy from scratch due to the need of maintaining the minimum spanning tree (MST) over a complete graph. This paper addresses the challenge of enhancing the clustering algorithm for dynamic data. We present an exact algorithm that maintains density information and updates the clustering hierarchy of HDBSCAN during point insertions and deletions. Considering the hardness of adapting the exact algorithm to dynamic data involving modern workloads, we propose an online-offline framework. The online component efficiently summarizes dynamic data using a tree structure, called Bubble-tree, while the offline step performs the static clustering. Experimental results demonstrate that the data summarization adapts well to fully dynamic environments, providing compression quality on par with existing techniques while significantly improving runtime performance of the clustering algorithm in dynamic data workloads.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringData SummarizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Scene Summarization: Clustering Scene Videos into Spatially Diverse Frames
We propose scene summarization as a new video-based scene understanding task. It aims to summarize a long video walkthrough of a scene into a small set of frames that are spatially diverse in the scene, which has many im…
ClusteringDiversityScene UnderstandingVideo Summarization+1Recursive Abstractive Processing for Retrieval in Dynamic Datasets
Recent retrieval-augmented models enhance basic methods by building a hierarchical structure over retrieved text chunks through recursive embedding, clustering, and summarization. The most relevant information is then re…
ClusteringRetrievalHERCULES: Hierarchical Embedding-based Recursive Clustering Using LLMs for Efficient Summarization
The explosive growth of complex datasets across various modalities necessitates advanced analytical tools that not only group data effectively but also provide human-understandable insights into the discovered structures…
ClusteringMeeting Summarization with Pre-training and Clustering Methods
Automatic meeting summarization is becoming increasingly popular these days. The ability to automatically summarize meetings and to extract key information could greatly increase the efficiency of our work and life. In t…
ClusteringLanguage ModelingLanguage ModellingMeeting Summarization+1Human Action Attribute Learning From Video Data Using Low-Rank Representations
Representation of human actions as a sequence of human body movements or action attributes enables the development of models for human activity recognition and summarization. We present an extension of the low-rank repre…
Action RecognitionActivity RecognitionAttributeClustering+2