paper-with-me

Papers

The Hyperdimensional Transform for Distributional Modelling, Regression and Classification

2023-11-14 · Pieter Dewulf, Bernard De Baets, Michiel Stock

Hyperdimensional computing (HDC) is an increasingly popular computing paradigm with immense potential for future intelligent applications. Although the main ideas already took form in the 1990s, HDC recently gained significant attention, especially in the field of machine learning and data science. Next to efficiency, interoperability and explainability, HDC offers attractive properties for generalization as it can be seen as an attempt to combine connectionist ideas from neural networks with symbolic aspects. In recent work, we introduced the hyperdimensional transform, revealing deep theoretical foundations for representing functions and distributions as high-dimensional holographic vectors. Here, we present the power of the hyperdimensional transform to a broad data science audience. We use the hyperdimensional transform as a theoretical basis and provide insight into state-of-the-art HDC approaches for machine learning. We show how existing algorithms can be modified and how this transform can lead to a novel, well-founded toolbox. Next to the standard regression and classification tasks of machine learning, our discussion includes various aspects of statistical modelling, such as representation, learning and deconvolving distributions, sampling, Bayesian inference, and uncertainty estimation.

📄 PDF Abstract BibTeX arXiv:2311.08150

Code (1)

padwulf/chap6_transform_applications 공식 구현

Tasks

Bayesian InferenceClassificationregressionRepresentation Learning

Similar Papers 제목 키워드 기반

The Hyperdimensional Transform: a Holographic Representation of Functions

2023-10-24 · Pieter Dewulf, Michiel Stock, Bernard De Baets

Integral transforms are invaluable mathematical tools to map functions into spaces where they are easier to characterize. We introduce the hyperdimensional transform as a new kind of integral transform. It converts squar…

Engression: Extrapolation through the Lens of Distributional Regression

2023-07-03 · Xinwei Shen, Nicolai Meinshausen

Distributional regression aims to estimate the full conditional distribution of a target variable, given covariates. Popular methods include linear and tree-ensemble based quantile regression. We propose a neural network…

quantile regressionregression

Distributional Refinement Network: Distributional Forecasting via Deep Learning

2024-06-03 · Benjamin Avanzi, Eric Dong, Patrick J. Laub, Bernard Wong

A key task in actuarial modelling involves modelling the distributional properties of losses. Classic (distributional) regression approaches like Generalized Linear Models (GLMs; Nelder and Wedderburn, 1972) are commonly…

Deep Learningregression

BiHDTrans: binary hyperdimensional transformer for efficient multivariate time series classification

2025-09-29 · Jingtao Zhang, Yi Liu, Qi Shen, Changhong Wang arxiv

The proliferation of Internet-of-Things (IoT) devices has led to an unprecedented volume of multivariate time series (MTS) data, requiring efficient and accurate processing for timely decision-making in resource-constrai…

Time Series Classification

Transformers Learn Robust In-Context Regression under Distributional Uncertainty

2026-03-19 · Hoang T. H. Cao, Hai D. V. Trinh, Tho Quan, Lan V. Truong arxiv

Recent work has shown that Transformers can perform in-context learning for linear regression under restrictive assumptions, including i.i.d. data, Gaussian noise, and Gaussian regression coefficients. However, real-worl…