paper-with-me

홈 › Papers

Sparse Modelling for Feature Learning in High Dimensional Data

2024-09-28 · Harish Neelam, Koushik Sai Veerella, Souradip Biswas

This paper presents an innovative approach to dimensionality reduction and feature extraction in high-dimensional datasets, with a specific application focus on wood surface defect detection. The proposed framework integrates sparse modeling techniques, particularly Lasso and proximal gradient methods, into a comprehensive pipeline for efficient and interpretable feature selection. Leveraging pre-trained models such as VGG19 and incorporating anomaly detection methods like Isolation Forest and Local Outlier Factor, our methodology addresses the challenge of extracting meaningful features from complex datasets. Evaluation metrics such as accuracy and F1 score, alongside visualizations, are employed to assess the performance of the sparse modeling techniques. Through this work, we aim to advance the understanding and application of sparse modeling in machine learning, particularly in the context of wood surface defect detection.

📄 PDF Abstract BibTeX arXiv:2409.19361

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionDefect DetectionDimensionality Reductionfeature selection

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Non-intrusive surrogate modelling using sparse random features with applications in crashworthiness analysis

2022-12-30 · Maternus Herold, Anna Veselovska, Jonas Jehle, Felix Krahmer

Efficient surrogate modelling is a key requirement for uncertainty quantification in data-driven scenarios. In this work, a novel approach of using Sparse Random Features for surrogate modelling in combination with self-…

Dimensionality ReductionSupervised dimensionality reductionUncertainty Quantification

Integrated Variational Fourier Features for Fast Spatial Modelling with Gaussian Processes

2023-08-27 · Talay M Cheema, Carl Edward Rasmussen

Sparse variational approximations are popular methods for scaling up inference and learning in Gaussian processes to larger datasets. For $N$ training points, exact inference has $O(N^3)$ cost; with $M \ll N$ features, s…

Gaussian Processes

Variational Autoencoders for Sparse and Overdispersed Discrete Data

2019-05-02 · He Zhao, Piyush Rai, Lan Du, Wray Buntine 외

Many applications, such as text modelling, high-throughput sequencing, and recommender systems, require analysing sparse, high-dimensional, and overdispersed discrete (count-valued or binary) data. Although probabilistic…

Collaborative FilteringMulti-Label LearningRecommendation Systems

Improving Group Lasso for high-dimensional categorical data

2022-10-25 · Szymon Nowakowski, Piotr Pokarowski, Wojciech Rejchel, Agnieszka Sołtys

Sparse modelling or model selection with categorical data is challenging even for a moderate number of variables, because one parameter is roughly needed to encode one category or level. The Group Lasso is a well known e…

Model SelectionVocal Bursts Intensity Prediction

Learning Minimal-Deviation Corrections for Multi-Dimensional Mismodelling in HEP Simulations

2026-05-08 · Matthias Schott, Lucie Flek arxiv

Accurate Monte Carlo (MC) modelling in high-energy physics is challenging, particularly in complex scenarios where simulations fail to reproduce observed data. In practice, experimental information is often limited to on…