Uniting contrastive and generative learning for event sequences models
High-quality representation of transactional sequences is vital for modern banking applications, including risk management, churn prediction, and personalized customer offers. Different tasks require distinct representation properties: local tasks benefit from capturing the client's current state, while global tasks rely on general behavioral patterns. Previous research has demonstrated that various self-supervised approaches yield representations that better capture either global or local qualities. This study investigates the integration of two self-supervised learning techniques - instance-wise contrastive learning and a generative approach based on restoring masked events in latent space. The combined approach creates representations that balance local and global transactional data characteristics. Experiments conducted on several public datasets, focusing on sequence classification and next-event type prediction, show that the integrated method achieves superior performance compared to individual approaches and demonstrates synergistic effects. These findings suggest that the proposed approach offers a robust framework for advancing event sequences representation learning in the financial sector.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningManagementRepresentation LearningSelf-Supervised LearningType predictionMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
MLEM: Generative and Contrastive Learning as Distinct Modalities for Event Sequences
This study explores the application of self-supervised learning techniques for event sequences. It is a key modality in various applications such as banking, e-commerce, and healthcare. However, there is limited research…
Contrastive LearningSelf-Supervised LearningGenerative Event Pretraining with Foundation Model Alignment
Event cameras provide robust visual signals under fast motion and challenging illumination conditions thanks to their microsecond latency and high dynamic range. However, their unique sensing characteristics and limited …
Object RecognitionDepth EstimationCoLES: Contrastive Learning for Event Sequences with Self-Supervision
We address the problem of self-supervised learning on discrete event sequences generated by real-world users. Self-supervised learning incorporates complex information from the raw data in low-dimensional fixed-length ve…
Contrastive LearningMetric LearningSelf-Supervised LearningAudioLog: LLMs-Powered Long Audio Logging with Hybrid Token-Semantic Contrastive Learning
Previous studies in automated audio captioning have faced difficulties in accurately capturing the complete temporal details of acoustic scenes and events within long audio sequences. This paper presents AudioLog, a larg…
Acoustic Scene ClassificationAudio captioningContrastive LearningEvent Detection+3Towards Contrastive Learning in Music Video Domain
Contrastive learning is a powerful way of learning multimodal representations across various domains such as image-caption retrieval and audio-visual representation learning. In this work, we investigate if these finding…
Contrastive LearningGenre classificationMusic TaggingRepresentation Learning+1