Memory-Efficient Sequential Pattern Mining with Hybrid Tries
This paper develops a memory-efficient approach for Sequential Pattern Mining (SPM), a fundamental topic in knowledge discovery that faces a well-known memory bottleneck for large data sets. Our methodology involves a novel hybrid trie data structure that exploits recurring patterns to compactly store the data set in memory; and a corresponding mining algorithm designed to effectively extract patterns from this compact representation. Numerical results on small to medium-sized real-life test instances show an average improvement of 85% in memory consumption and 49% in computation time compared to the state of the art. For large data sets, our algorithm stands out as the only capable SPM approach within 256GB of system memory, potentially saving 1.7TB in memory consumption.
Code (1)
Tasks
Sequential Pattern MiningSimilar Papers 제목 키워드 기반
Deep learning-based sequential pattern mining for progressive database
Sequential pattern mining (SPM) is one of the main application areas in the field of online business, e-commerce, bioinformatics, etc. The traditional approaches in SPM are unable to accurately mine the huge volume of da…
Deep LearningSequential Pattern MiningTime SeriesTime Series AnalysisHybrid Recommender System Based on Personal Behavior Mining
Recommender systems are mostly well known for their applications in e-commerce sites and are mostly static models. Classical personalized recommender algorithm includes item-based collaborative filtering method applied i…
Collaborative FilteringRecommendation SystemsSequential Pattern MiningTaSPM: Targeted Sequential Pattern Mining
Sequential pattern mining (SPM) is an important technique of pattern mining, which has many applications in reality. Although many efficient sequential pattern mining algorithms have been proposed, there are few studies …
Sequential Pattern MiningEfficiency Analysis of ASP Encodings for Sequential Pattern Mining Tasks
This article presents the use of Answer Set Programming (ASP) to mine sequential patterns. ASP is a high-level declarative logic programming paradigm for high level encoding combinatorial and optimization problem solving…
Sequential Pattern MiningMining compact high utility sequential patterns
High utility sequential pattern mining (HUSPM) aims to mine all patterns that yield a high utility (profit) in a sequence dataset. HUSPM is useful for several applications such as market basket analysis, marketing, and w…
MarketingSequential Pattern MiningVocal Bursts Intensity Prediction