paper-with-me

Papers

Discriminative and Generative Learning for Linear Estimation of Random Signals [Lecture Notes]

2022-06-09 · Nir Shlezinger, Tirza Routtenberg

Inference tasks in signal processing are often characterized by the availability of reliable statistical modeling with some missing instance-specific parameters. One conventional approach uses data to estimate these missing parameters and then infers based on the estimated model. Alternatively, data can also be leveraged to directly learn the inference mapping end-to-end. These approaches for combining partially-known statistical models and data in inference are related to the notions of generative and discriminative models used in the machine learning literature, typically considered in the context of classifiers. The goal of this lecture note is to introduce the concepts of generative and discriminative learning for inference with a partially-known statistical model. While machine learning systems often lack the interpretability of traditional signal processing methods, we focus on a simple setting where one can interpret and compare the approaches in a tractable manner that is accessible and relevant to signal processing readers. In particular, we exemplify the approaches for the task of Bayesian signal estimation in a jointly Gaussian setting with the mean-squared error (MSE) objective, i.e., a linear estimation setting.

📄 PDF Abstract BibTeX arXiv:2206.04432

Code (0)

등록된 구현이 없습니다.

Tasks

BIG-bench Machine Learning

Similar Papers 제목 키워드 기반

IRGAN: A Minimax Game for Unifying Generative and Discriminative Information Retrieval Models

2017-05-30 · Jun Wang, Lantao Yu, Wei-Nan Zhang, Yu Gong 외

This paper provides a unified account of two schools of thinking in information retrieval modelling: the generative retrieval focusing on predicting relevant documents given a query, and the discriminative retrieval focu…

Ad-Hoc Information RetrievalDocument RankingInformation RetrievalQuestion Answering+1

On equivalence between linear-chain conditional random fields and hidden Markov chains

2021-11-14 · Elie Azeraf, Emmanuel Monfrini, Wojciech Pieczynski

Practitioners successfully use hidden Markov chains (HMCs) in different problems for about sixty years. HMCs belong to the family of generative models and they are often compared to discriminative models, like conditiona…

A Logic-based Approach to Generatively Defined Discriminative Modeling

2014-10-15 · Taisuke Sato, Keiichi Kubota, Yoshitaka Kameya

Conditional random fields (CRFs) are usually specified by graphical models but in this paper we propose to use probabilistic logic programs and specify them generatively. Our intension is first to provide a unified appro…

Semi-supervised Neural Chord Estimation Based on a Variational Autoencoder with Latent Chord Labels and Features

2020-05-14 · Yiming Wu, Tristan Carsault, Eita Nakamura, Kazuyoshi Yoshii

This paper describes a statistically-principled semi-supervised method of automatic chord estimation (ACE) that can make effective use of music signals regardless of the availability of chord annotations. The typical app…

General ClassificationVariational Inference

Towards Reliable Objective Evaluation Metrics for Generative Singing Voice Separation Models

2025-07-15 · Paul A. Bereuter, Benjamin Stahl, Mark D. Plumbley, Alois Sontacchi

Traditional Blind Source Separation Evaluation (BSS-Eval) metrics were originally designed to evaluate linear audio source separation models based on methods such as time-frequency masking. However, recent generative mod…

Audio Source Separationblind source separation