Supervised Quantile Normalisation
Quantile normalisation is a popular normalisation method for data subject to unwanted variations such as images, speech, or genomic data. It applies a monotonic transformation to the feature values of each sample to ensure that after normalisation, they follow the same target distribution for each sample. Choosing a "good" target distribution remains however largely empirical and heuristic, and is usually done independently of the subsequent analysis of normalised data. We propose instead to couple the quantile normalisation step with the subsequent analysis, and to optimise the target distribution jointly with the other parameters in the analysis. We illustrate this principle on the problem of estimating a linear model over normalised data, and show that it leads to a particular low-rank matrix regression problem that can be solved efficiently. We illustrate the potential of our method, which we term SUQUAN, on simulated data, images and genomic data, where it outperforms standard quantile normalisation.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Functional-Coefficient Quantile Regression for Panel Data with Latent Group Structure
This paper considers estimating functional-coefficient models in panel quantile regression with individual effects, allowing the cross-sectional and temporal dependence for large panel observations. A latent group struct…
quantile regressionregressionTIMEN: An Open Temporal Expression Normalisation Resource
Temporal expressions are words or phrases that describe a point, duration or recurrence in time. Automatically annotating these expressions is a research goal of increasing interest. Recognising them can be achieved with…
Information RetrievalKnowledge Base PopulationQuestion AnsweringTimex normalizationA Simple Baseline for Semi-supervised Semantic Segmentation with Strong Data Augmentation
Recently, significant progress has been made on semantic segmentation. However, the success of supervised semantic segmentation typically relies on a large amount of labelled data, which is time-consuming and costly to o…
Data Augmentationimage-classificationImage ClassificationPseudo Label+3An Unsupervised method for OCR Post-Correction and Spelling Normalisation for Finnish
Historical corpora are known to contain errors introduced by OCR (optical character recognition) methods used in the digitization process, often said to be degrading the performance of NLP systems. Correcting these error…
Machine TranslationNMTOptical Character RecognitionOptical Character Recognition (OCR)+1Normalisation is dead, long live normalisation!
Since the advent of Batch Normalisation (BN) almost every state-of-the-art (SOTA) method uses some form of normalisation. After all, normalisation generally speeds up learning and leads to models that generalise better t…
Form