Learning Set Functions that are Sparse in Non-Orthogonal Fourier Bases
Many applications of machine learning on discrete domains, such as learning preference functions in recommender systems or auctions, can be reduced to estimating a set function that is sparse in the Fourier domain. In this work, we present a new family of algorithms for learning Fourier-sparse set functions. They require at most $nk - k \log_2 k + k$ queries (set function evaluations), under mild conditions on the Fourier coefficients, where $n$ is the size of the ground set and $k$ the number of non-zero Fourier coefficients. In contrast to other work that focused on the orthogonal Walsh-Hadamard transform, our novel algorithms operate with recently introduced non-orthogonal Fourier transforms that offer different notions of Fourier-sparsity. These naturally arise when modeling, e.g., sets of items forming substitutes and complements. We demonstrate effectiveness on several real-world applications.
Code (3)
Tasks
Recommendation SystemsSimilar Papers 제목 키워드 기반
Machine Learning Assisted Orthonormal Basis Selection for Functional Data Analysis
In implementations of the functional data methods, the effect of the initial choice of an orthonormal basis has not gained much attention in the past. Typically, several standard bases such as Fourier, wavelets, splines,…
BIG-bench Machine LearningLearning Orthonormal Bases for Function Spaces
Infinite-dimensional orthonormal basis expansions play a central role in representing and computing with function spaces due to their favorable linear algebraic properties. However, common bases such as Fourier or wavele…
Physical SimulationsFourier Weak SINDy: Spectral Test Function Selection for Robust Model Identification
We introduce Fourier Weak SINDy, a minimal noise-robust and interpretable derivative-free equation learning method that combines weak-form sparse equation learning with spectral density estimation for data-driven test fu…
Density EstimationMany Perception Tasks are Highly Redundant Functions of their Input Data
We show that many perception tasks, from visual recognition, semantic segmentation, optical flow, depth estimation to vocalization discrimination, are highly redundant functions of their input data. Images or spectrogram…
Depth EstimationOptical Flow EstimationSemantic SegmentationIll-Conditioning in Dictionary-Based Dynamic-Equation Learning: A Systems Biology Case Study
Data-driven discovery of governing equations from time-series data provides a powerful framework for understanding complex biological systems. Library-based approaches that use sparse regression over candidate functions …