paper-with-me

Papers

Kernel Three Pass Regression Filter

2024-05-12 · Rajveer Jat, Daanish Padha

We forecast a single time series using a high-dimensional set of predictors. When these predictors share common underlying dynamics, an approximate latent factor model provides a powerful characterization of their co-movements Bai(2003). These latent factors succinctly summarize the data and can also be used for prediction, alleviating the curse of dimensionality in high-dimensional prediction exercises, see Stock & Watson (2002a). However, forecasting using these latent factors suffers from two potential drawbacks. First, not all pervasive factors among the set of predictors may be relevant, and using all of them can lead to inefficient forecasts. The second shortcoming is the assumption of linear dependence of predictors on the underlying factors. The first issue can be addressed by using some form of supervision, which leads to the omission of irrelevant information. One example is the three-pass regression filter proposed by Kelly & Pruitt (2015). We extend their framework to cases where the form of dependence might be nonlinear by developing a new estimator, which we refer to as the Kernel Three-Pass Regression Filter (K3PRF). This alleviates the aforementioned second shortcoming. The estimator is computationally efficient and performs well empirically. The short-term performance matches or exceeds that of established models, while the long-term performance shows significant improvement.

📄 PDF Abstract BibTeX arXiv:2405.07292

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Cross-Space Adaptive Filter: Integrating Graph Topology and Node Attributes for Alleviating the Over-smoothing Problem

2024-01-26 · Chen Huang, Haoyang Li, Yifan Zhang, Wenqiang Lei 외

The vanilla Graph Convolutional Network (GCN) uses a low-pass filter to extract low-frequency signals from graph topology, which may lead to the over-smoothing problem when GCN goes deep. To this end, various methods hav…

AttributeNode Classification

Mechanistic Evidence for Spectral Structures in Prior-Data Fitted Networks

2026-01-29 · Kaustubh Sharma, Srijan Tiwari, Ojasva Nema, Parikshit Pareek arxiv

Prior-Data Fitted Networks (PFNs) enable amortized Bayesian inference in a single forward pass, yet their internal representations remain opaque. It is unknown whether PFNs encode identifiable Bayesian structure or merel…

Bayesian Inference

Improved learning theory for kernel distribution regression with two-stage sampling

2023-08-28 · François Bachoc, Louis Béthune, Alberto González-Sanz, Jean-Michel Loubes

The distribution regression problem encompasses many important statistics and machine learning tasks, and arises in a large range of applications. Among various existing approaches to tackle this problem, kernel methods …

Learning Theoryregression

A least squares support vector regression for anisotropic diffusion filtering

2022-01-30 · Arsham Gholamzadeh Khoee, Kimia Mohammadi Mohammadi, Mostafa Jani, Kourosh Parand

Anisotropic diffusion filtering for signal smoothing as a low-pass filter has the advantage of the edge-preserving, i.e., it does not affect the edges that contain more critical data than the other parts of the signal. I…

regression

A Comparative Study of Pairwise Learning Methods based on Kernel Ridge Regression

2018-03-05 · Michiel Stock, Tapio Pahikkala, Antti Airola, Bernard De Baets 외

Many machine learning problems can be formulated as predicting labels for a pair of objects. Problems of that kind are often referred to as pairwise learning, dyadic prediction or network inference problems. During the l…

BIG-bench Machine LearningregressionZero-Shot Learning