paper-with-me

홈 › Papers

Towards Hybrid-grained Feature Interaction Selection for Deep Sparse Network

2023-10-23 · NeurIPS 2023 11 · Fuyuan Lyu, Xing Tang, Dugang Liu, Chen Ma, Weihong Luo, Liang Chen, Xiuqiang He, Xue Liu

Deep sparse networks are widely investigated as a neural network architecture for prediction tasks with high-dimensional sparse features, with which feature interaction selection is a critical component. While previous methods primarily focus on how to search feature interaction in a coarse-grained space, less attention has been given to a finer granularity. In this work, we introduce a hybrid-grained feature interaction selection approach that targets both feature field and feature value for deep sparse networks. To explore such expansive space, we propose a decomposed space which is calculated on the fly. We then develop a selection algorithm called OptFeature, which efficiently selects the feature interaction from both the feature field and the feature value simultaneously. Results from experiments on three large real-world benchmark datasets demonstrate that OptFeature performs well in terms of accuracy and efficiency. Additional studies support the feasibility of our method.

📄 PDF Abstract BibTeX arXiv:2310.15342

Code (1)

fuyuanlyu/optfeature 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Focus 설명 없음

Similar Papers 제목 키워드 기반

Hybrid Interest Modeling for Long-tailed Users

2020-12-29 · Lifang Deng, Jin Niu, Angulia Yang, Qidi Xu 외

User behavior modeling is a key technique for recommender systems. However, most methods focus on head users with large-scale interactions and hence suffer from data sparsity issues. Several solutions integrate side info…

ClusteringRecommendation SystemsSelf-Supervised Learning

TabNSA: Native Sparse Attention for Efficient Tabular Data Learning

2025-03-12 · Ali Eslamian, Qiang Cheng

Tabular data poses unique challenges for deep learning due to its heterogeneous features and lack of inherent spatial structure. This paper introduces TabNSA, a novel deep learning architecture leveraging Native Sparse A…

Deep Learningfeature selectiontabular-classification

FSHNet: Fully Sparse Hybrid Network for 3D Object Detection

2025-01-01 · CVPR 2025 1 · Shuai Liu, Mingyue Cui, Boyang Li, Quanmin Liang 외

Fully sparse 3D detectors have recently gained significant attention due to their efficiency in long-range detection. However, sparse 3D detectors extract features only from non-empty voxels, which impairs long-range…

3D Object Detectionobject-detectionObject Detection

Exploring Pose-Aware Human-Object Interaction via Hybrid Learning

2024-01-01 · CVPR 2024 1 · Eastman Z Y Wu, YaLi Li, YuAn Wang, Shengjin Wang

Human-Object Interaction (HOI) detection plays a crucial role in visual scene comprehension. In recent advancements two-stage detectors have taken a prominent position. However they are encumbered by two primary chal…

Human-Object Interaction DetectionObject

Factorization Machines with Regularization for Sparse Feature Interactions

2020-10-19 · Kyohei Atarashi, Satoshi Oyama, Masahito Kurihara

Factorization machines (FMs) are machine learning predictive models based on second-order feature interactions and FMs with sparse regularization are called sparse FMs. Such regularizations enable feature selection, whic…

feature selection