paper-with-me

홈 › Papers

GLINT-RU: Gated Lightweight Intelligent Recurrent Units for Sequential Recommender Systems

2024-06-06 · Sheng Zhang, Maolin Wang, Wanyu Wang, Jingtong Gao, Xiangyu Zhao, Yu Yang, Xuetao Wei, Zitao Liu, Tong Xu

Transformer-based models have gained significant traction in sequential recommender systems (SRSs) for their ability to capture user-item interactions effectively. However, these models often suffer from high computational costs and slow inference. Meanwhile, existing efficient SRS approaches struggle to embed high-quality semantic and positional information into latent representations. To tackle these challenges, this paper introduces GLINT-RU, a lightweight and efficient SRS leveraging a single-layer dense selective Gated Recurrent Units (GRU) module to accelerate inference. By incorporating a dense selective gate, GLINT-RU adaptively captures temporal dependencies and fine-grained positional information, generating high-quality latent representations. Additionally, a parallel mixing block infuses fine-grained positional features into user-item interactions, enhancing both recommendation quality and efficiency. Extensive experiments on three datasets demonstrate that GLINT-RU achieves superior prediction accuracy and inference speed, outperforming baselines based on RNNs, Transformers, MLPs, and SSMs. These results establish GLINT-RU as a powerful and efficient solution for SRSs.

📄 PDF Abstract BibTeX arXiv:2406.10244

Code (0)

등록된 구현이 없습니다.

Tasks

Recommendation SystemsSequential Recommendation

Methods 이 논문이 사용한 방법론

SRS Sticker Response Selector, or SRS, is a model for multi-turn dialog that automatically selects a sticker response. SRS first employs a convolutional based sticker image…
Residual Connection 설명 없음
SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
GRU A Gated Recurrent Unit, or GRU, is a type of recurrent neural network. It is similar to an LSTM, but only has two gates - a reset…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…

Similar Papers 제목 키워드 기반

Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling

2014-12-11 · Junyoung Chung, Caglar Gulcehre, Kyunghyun Cho, Yoshua Bengio

In this paper we compare different types of recurrent units in recurrent neural networks (RNNs). Especially, we focus on more sophisticated units that implement a gating mechanism, such as a long short-term memory (LSTM)…

Music Modeling

Traffic Flow Forecast of Road Networks with Recurrent Neural Networks

2020-06-08 · Ralf Rüther, Andreas Klos, Marius Rosenbaum, Wolfram Schiffmann

The interest in developing smart cities has increased dramatically in recent years. In this context an intelligent transportation system depicts a major topic. The forecast of traffic flow is indispensable for an efficie…

Gated Feedback Recurrent Neural Networks

2015-02-09 · Junyoung Chung, Caglar Gulcehre, Kyunghyun Cho, Yoshua Bengio

In this work, we propose a novel recurrent neural network (RNN) architecture. The proposed RNN, gated-feedback RNN (GF-RNN), extends the existing approach of stacking multiple recurrent layers by allowing and controlling…

Language ModelingLanguage Modelling

Gated Recurrent Networks for Seizure Detection

2018-01-03 · Meysam Golmohammadi, Saeedeh Ziyabari, Vinit Shah, Eva Von Weltin 외

Recurrent Neural Networks (RNNs) with sophisticated units that implement a gating mechanism have emerged as powerful technique for modeling sequential signals such as speech or electroencephalography (EEG). The latter is…

EEGElectroencephalogram (EEG)Seizure Detection

GLINT: Sparsely Gated Vision-Language Alignment for Fine-Grained Radiology Representations

2026-06-02 · Jonggwon Park, Seongeun Lee, Junhyun Park, Hannah Yun 외 arxiv

Vision-language models (VLMs) for radiology have emerged as a scalable paradigm by leveraging image-report pairs naturally produced in clinical workflows. However, this pairing reveals a mismatch in scale: each finding o…

Self-Supervised Learning