paper-with-me

Papers

Dictionary Learning with Convex Update (ROMD)

2021-10-13 · Cheng Cheng, Wei Dai

Dictionary learning aims to find a dictionary under which the training data can be sparsely represented, and it is usually achieved by iteratively applying two stages: sparse coding and dictionary update. Typical methods for dictionary update focuses on refining both dictionary atoms and their corresponding sparse coefficients by using the sparsity patterns obtained from sparse coding stage, and hence it is a non-convex bilinear inverse problem. In this paper, we propose a Rank-One Matrix Decomposition (ROMD) algorithm to recast this challenge into a convex problem by resolving these two variables into a set of rank-one matrices. Different from methods in the literature, ROMD updates the whole dictionary at a time using convex programming. The advantages hence include both convergence guarantees for dictionary update and faster convergence of the whole dictionary learning. The performance of ROMD is compared with other benchmark dictionary learning algorithms. The results show the improvement of ROMD in recovery accuracy, especially in the cases of high sparsity level and fewer observation data.

📄 PDF Abstract BibTeX arXiv:2110.06641

Code (0)

등록된 구현이 없습니다.

Tasks

Dictionary Learning

Similar Papers 제목 키워드 기반

PromDA: Prompt-based Data Augmentation for Low-Resource NLU Tasks

2022-02-25 · ACL 2022 5 · YuFei Wang, Can Xu, Qingfeng Sun, Huang Hu 외

This paper focuses on the Data Augmentation for low-resource Natural Language Understanding (NLU) tasks. We propose Prompt-based D}ata Augmentation model (PromDA) which only trains small-scale Soft Prompt (i.e., a set of…

Data AugmentationNatural Language Understanding

Let’s be Honest: An Optimal No-Regret Framework for Zero-Sum Games

2018-07-01 · ICML 2018 7 · Ehsan Asadi Kangarshahi, Ya-Ping Hsieh, Mehmet Fatih Sahin, Volkan Cevher

We revisit the problem of solving two-player zero-sum games in the decentralized setting. We propose a simple algorithmic framework that simultaneously achieves the best rates for honest regret as well as adversaria…

Deep Residual Autoencoders for Expectation Maximization-inspired Dictionary Learning

2019-04-18 · Bahareh Tolooshams, Sourav Dey, Demba Ba

We introduce a neural-network architecture, termed the constrained recurrent sparse autoencoder (CRsAE), that solves convolutional dictionary learning problems, thus establishing a link between dictionary learning and ne…

DenoisingDictionary LearningImage Denoising

TUANDROMD-X: Advanced Entropy and Visual Analytics Dataset for Enhanced Malware Detection and Classification

2026-05-07 · Parthajit Borah, Upasana Sarmah, D. K. Bhattacharyya, J. K. Kalita arxiv

Malware and malware-based attacks are becoming more prevalent and complex. Attackers regularly come up with new techniques that have the ability to evade conventional and signature-based malware defense. In order to addr…

Feature EngineeringMalware Detection

PAC Reinforcement Learning without Real-World Feedback

2019-09-23 · Yuren Zhong, Aniket Anand Deshmukh, Clayton Scott

This work studies reinforcement learning in the Sim-to-Real setting, in which an agent is first trained on a number of simulators before being deployed in the real world, with the aim of decreasing the real-world sample …

reinforcement-learningReinforcement LearningReinforcement Learning (RL)