paper-with-me

Papers

Fast Machine Learning Method with Vector Embedding on Orthonormal Basis and Spectral Transform

2023-10-27 · Louis Yu Lu

This paper presents a novel fast machine learning method that leverages two techniques: Vector Embedding on Orthonormal Basis (VEOB) and Spectral Transform (ST). The VEOB converts the original data encoding into a vector embedding with coordinates projected onto orthonormal bases. The Singular Value Decomposition (SVD) technique is used to calculate the vector basis and projection coordinates, leading to an enhanced distance measurement in the embedding space and facilitating data compression by preserving the projection vectors associated with the largest singular values. On the other hand, ST transforms sequence of vector data into spectral space. By applying the Discrete Cosine Transform (DCT) and selecting the most significant components, it streamlines the handling of lengthy vector sequences. The paper provides examples of word embedding, text chunk embedding, and image embedding, implemented in Julia language with a vector database. It also investigates unsupervised learning and supervised learning using this method, along with strategies for handling large data volumes.

📄 PDF Abstract BibTeX arXiv:2310.18424

Code (1)

louisyulu/veob-and-st 공식 구현

Tasks

Data Compression

Methods 이 논문이 사용한 방법론

Discrete Cosine Transform Discrete Cosine Transform (DCT) is an orthogonal transformation method that decomposes an image to its spatial frequency spectrum. It expresses a finite sequence of data…

Similar Papers 제목 키워드 기반

Enhanced Boolean Correlation Matrix Memory

2016-07-11 · Mario Mastriani

This paper introduces an Enhanced Boolean version of the Correlation Matrix Memory (CMM), which is useful to work with binary memories. A novel Boolean Orthonormalization Process (BOP) is presented to convert a non-ortho…

Fast optimization of common basis for matrix set through Common Singular Value Decomposition

2022-04-18 · Jarek Duda

SVD (singular value decomposition) is one of the basic tools of machine learning, allowing to optimize basis for a given matrix. However, sometimes we have a set of matrices $\{A_k\}_k$ instead, and would like to optimiz…

Video Compression

Approximate Eigenvalue Decompositions of Linear Transformations with a Few Householder Reflectors

2018-11-19 · Cristian Rusu

The ability to decompose a signal in an orthonormal basis (a set of orthogonal components, each normalized to have unit length) using a fast numerical procedure rests at the heart of many signal processing methods and ap…

Unifying Optimization Methods for Color Filter Design

2020-06-24 · Graham Finlayson, Yuteng Zhu

Through optimization we can solve for a filter that when the camera views the world through this filter, it is more colorimetric. Previous work solved for the filter that best satisfied the Luther condition: the camera s…

Fast Haar Transforms for Graph Neural Networks

2019-07-10 · Ming Li, Zheng Ma, Yu Guang Wang, Xiaosheng Zhuang

Graph Neural Networks (GNNs) have become a topic of intense research recently due to their powerful capability in high-dimensional classification and regression tasks for graph-structured data. However, as GNNs typically…

General ClassificationNode Classificationregression