Fingerprinting Concepts in Data Streams with Supervised and Unsupervised Meta-Information
Streaming sources of data are becoming more common as the ability to collect data in real-time grows. A major concern in dealing with data streams is concept drift, a change in the distribution of data over time, for example, due to changes in environmental conditions. Representing concepts (stationary periods featuring similar behaviour) is a key idea in adapting to concept drift. By testing the similarity of a concept representation to a window of observations, we can detect concept drift to a new or previously seen recurring concept. Concept representations are constructed using meta-information features, values describing aspects of concept behaviour. We find that previously proposed concept representations rely on small numbers of meta-information features. These representations often cannot distinguish concepts, leaving systems vulnerable to concept drift. We propose FiCSUM, a general framework to represent both supervised and unsupervised behaviours of a concept in a fingerprint, a vector of many distinct meta-information features able to uniquely identify more concepts. Our dynamic weighting strategy learns which meta-information features describe concept drift in a given dataset, allowing a diverse set of meta-information features to be used at once. FiCSUM outperforms state-of-the-art methods over a range of 11 real world and synthetic datasets in both accuracy and modeling underlying concept drift.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Accurate parameter estimation using scan-specific unsupervised deep learning for relaxometry and MR fingerprinting
We propose an unsupervised convolutional neural network (CNN) for relaxation parameter estimation. This network incorporates signal relaxation and Bloch simulations while taking advantage of residual learning and spatial…
parameter estimationOpen World Autoencoding Drift Detection with Novel Class Recognition in Tabular Non-stationary Data Streams
Data stream processing has become a landmark in modern machine learning applications, with concept drifts and novel class appearances posing the primary challenges faced by sophisticated recognition methods. This work pr…
Density Estimationp-FP: Extraction, Classification, and Prediction of Website Fingerprints with Deep Learning
Recent advances in learning Deep Neural Network (DNN) architectures have received a great deal of attention due to their ability to outperform state-of-the-art classifiers across a wide range of applications, with little…
Feature EngineeringGeneral ClassificationWebsite Fingerprinting AttacksUnsupervised Semantic Scene Labeling for Streaming Data
We introduce an unsupervised semantic scene labeling approach that continuously learns and adapts semantic models discovered within a data stream. While closely related to unsupervised video segmentation, our algorithm i…
Scene LabelingSegmentationVideo SegmentationVideo Semantic SegmentationThe Wyner Variational Autoencoder for Unsupervised Multi-Layer Wireless Fingerprinting
Wireless fingerprinting refers to a device identification method leveraging hardware imperfections and wireless channel variations as signatures. Beyond physical layer characteristics, recent studies demonstrated that us…
Variational Inference