Compressed imitation learning
In analogy to compressed sensing, which allows sample-efficient signal reconstruction given prior knowledge of its sparsity in frequency domain, we propose to utilize policy simplicity (Occam's Razor) as a prior to enable sample-efficient imitation learning. We first demonstrated the feasibility of this scheme on linear case where state-value function can be sampled directly. We also extended the scheme to scenarios where only actions are visible and scenarios where the policy is obtained from nonlinear network. The method is benchmarked against behavior cloning and results in significantly higher scores with limited expert demonstrations.
Code (0)
등록된 구현이 없습니다.
Tasks
compressed sensingImitation LearningSimilar Papers 제목 키워드 기반
Action Assembly: Sparse Imitation Learning for Text Based Games with Combinatorial Action Spaces
We propose a computationally efficient algorithm that combines compressed sensing with imitation learning to solve text-based games with combinatorial action spaces. Specifically, we introduce a new compressed sensing al…
compressed sensingDecision MakingImitation Learningtext-based games+1Extraction of Projection Profile, Run-Histogram and Entropy Features Straight from Run-Length Compressed Text-Documents
Document Image Analysis, like any Digital Image Analysis requires identification and extraction of proper features, which are generally extracted from uncompressed images, though in reality images are made available in c…
A Diffusion Model Based Quality Enhancement Method for HEVC Compressed Video
Video post-processing methods can improve the quality of compressed videos at the decoder side. Most of the existing methods need to train corresponding models for compressed videos with different quantization parameters…
DecoderQuantizationExtraction of Line Word Character Segments Directly from Run Length Compressed Printed Text Documents
Segmentation of a text-document into lines, words and characters, which is considered to be the crucial pre-processing stage in Optical Character Recognition (OCR) is traditionally carried out on uncompressed documents, …
Optical Character RecognitionOptical Character Recognition (OCR)SegmentationThe General sampling theorem, Compressed sensing and a method of image sampling and reconstruction with sampling rates close to the theoretical limit
The article addresses the problem of image sampling with minimal possible sampling rates and reviews the recent advances in sampling theory and methods: modern formulations of the sampling theorems, potentials and limita…
compressed sensing