paper-with-me

홈 › Papers

Data Smashing 2.0: Sequence Likelihood (SL) Divergence For Fast Time Series Comparison

2019-09-26 · Yi Huang, Ishanu Chattopadhyay

Recognizing subtle historical patterns is central to modeling and forecasting problems in time series analysis. Here we introduce and develop a new approach to quantify deviations in the underlying hidden generators of observed data streams, resulting in a new efficiently computable universal metric for time series. The proposed metric is in the sense that we can compare and contrast data streams regardless of where and how they are generated and without any feature engineering step. The approach proposed in this paper is conceptually distinct from our previous work on data smashing, and vastly improves discrimination performance and computing speed. The core idea here is the generalization of the notion of KL divergence often used to compare probability distributions to a notion of divergence in time series. We call this the sequence likelihood (SL) divergence, which may be used to measure deviations within a well-defined class of discrete-valued stochastic processes. We devise efficient estimators of SL divergence from finite sample paths and subsequently formulate a universal metric useful for computing distance between time series produced by hidden stochastic generators.

📄 PDF Abstract BibTeX arXiv:1909.12243

Code (0)

등록된 구현이 없습니다.

Tasks

Feature EngineeringTime SeriesTime Series Analysis

Similar Papers 제목 키워드 기반

SequenceMatch: Imitation Learning for Autoregressive Sequence Modelling with Backtracking

2023-06-08 · Chris Cundy, Stefano Ermon

In many domains, autoregressive models can attain high likelihood on the task of predicting the next observation. However, this maximum-likelihood (MLE) objective does not necessarily match a downstream use-case of autor…

Imitation LearningText Generation

Data Smashing

2014-01-03 · Ishanu Chattopadhyay, Hod Lipson

Investigation of the underlying physics or biology from empirical data requires a quantifiable notion of similarity - when do two observed data sets indicate nearly identical generating processes, and when they do not. T…

Alpha-divergence bridges maximum likelihood and reinforcement learning in neural sequence generation

2018-01-01 · ICLR 2018 1 · Sotetsu Koyamada, Yuta Kikuchi, Atsunori Kanemura, Shin-ichi Maeda 외

Neural sequence generation is commonly approached by using maximum- likelihood (ML) estimation or reinforcement learning (RL). However, it is known that they have their own shortcomings; ML presents training/testing disc…

Machine Translationreinforcement-learningReinforcement LearningReinforcement Learning (RL)+1

Joint Distillation for Fast Likelihood Evaluation and Sampling in Flow-based Models

2025-12-02 · Xinyue Ai, Yutong He, Albert Gu, Ruslan Salakhutdinov 외 arxiv

Log-likelihood evaluation enables important capabilities in generative models, including model comparison, certain fine-tuning objectives, and many downstream applications. Yet paradoxically, some of today's best generat…

StAD: Stein Amortized Divergence for Fast Likelihoods with Diffusion and Flow

2026-05-15 · Gurjeet Jagwani, Stephen Thorp, Sinan Deger, Hiranya Peiris arxiv

Diffusion and flow-based models are ubiquitously used for generative modelling and density estimation. They admit a deterministic probability flow ordinary differential equation (PF-ODE), analogous to continuous normaliz…

Density Estimation